粉丝594获赞2.8万


now ai is a great thing because ai will solve all the problems that you have today, it will solve employment, it will solve disease, it will solve poverty, but it will also create new problems the problem of fake news is going to be a million times worse cyber attacks will become much more extreme we will have totally automated ai weapons i think ai has the potential to create infinity stable dictatorships this morning, a warning about the power of artificial intelligence more than 1300 tech industry, leaders, researchers and others are now asking for a pause in the development of artificial intelligence to consider the risks plain god scientists have been accused of plain god for a while, but there is a real sense in which we are creating something very different from anything you've created so far yeah i mean we definitely will be able to create completely autonomous beings with their own goals and it will be very important especially as these beings become much smarter than humans it's important to be important to have these beings as the goals of these beings be aligned with our goals what inspires me i like thinking about the very fundamentals the basics what can our systems not do is that humans definitely do almost approaches philosophically questions like what is learning what is experience? what is thinking how does the brain work? i feel that technology is a force of nature i feel like there is a lot of similarity between technology and biological evolution it is very easy to understand how biological evolution works you have mutations you have natural selections you keep the good ones the ones that survive and just through this process you're gonna have huge complexity in your organisms we cannot understand how the human body works because we understandable pollution let me understand the process more or less and i think machine learning is in a similar state right now, especially deep learning we have very simple, a very simple rule that takes the information from the data and puts it into the model and we just keep repeating this process and as a result of this process the complexity from the data gets transformed, transferred into the complexity of the model so the resulting model is really complex and we don't really know exactly how it works you need to investigate, but the algorithm that did it is very simple chap gpt maybe you've heard of it if you haven't then get ready you describe it as the first spots of rain before a downpour, it's something we just need to be very conscious of because i agree it is a watershed moment well chad gbt is being heralded as a game changer and in many ways, it is it's latest trying out the outscoring people our recent study by microsoft research concludes that gpd4 is in early yet still incomplete artificial general intelligence system, artificial general intelligence agi, a computer system that can do any job or any task that a human does, but only better there is some probability the agi is going to happen pretty soon, there's also some probability is going to take much longer, but my position is that the probability that a jack would happen soon is high enough that you should take it seriously and it's going to be very important to make these very smart capable systems be aligned and act in our best interest the very first day gis will be basically very very large data centers packed with specialized neural network processors working in parallel compact hot power hungry package consuming like 10 million homes worth of energy if you're going to see dramatically more intelligent systems and i think it's highly likely that those systems will have completely astronomical impact on society we will humans actually benefit and who will benefit? who will not the beliefs and desires of the first agis will be extremely important and so it's important to problem correctly i think that if this is not done then the nature will be volution of natural selection favor those systems prioritize their own survival bubble ups it's not that it's going to actively hate humans and want to harm them, but it is going to be too powerful and i think a good analogy would be the way humans treat animals it's not to be hate animals i think humans love animals and have a lot of affection for them, but when the time comes to build a highway between two cities we are not asking the animals for permission we just do it because it's important for us and i think by default that's the kind of relationship that's going to be between us and agis, which are truly autonomous and operating on their own behalf many machine learning experts people who are very knowledgeable and very experienced have a lot of skepticism about each year about when it could happen and about the weather it could happen at all right now this is something that just not that many people have realized yet that the speed of computers for neural networks for ai are going to become maybe 2000 times faster in a small number of years if you have an arms race dynamics between multiple teams trying to build agi first, they will have less time make sure that the agi they will build been care deeply for humans because the way i imagine it is that there is an avalanche like there is an avalanche of agi development imagine it was huge unstockable force and i think it's pretty likely the entire surface of the earth will be covered with solar panels and data centers given these kinds of concerns it will be important that the agi somehow built as a cooperation between multiple countries the future is going to be good for the guys regardless would be nice if you were good for humans as well。



沙姆奥特曼和伊利亚的底层矛盾到底是什么?今天给大家讲两个概念,有效加速主义和人工智能超级对齐。有效加速主义英文名 e a c c, 是一群硅谷的科技精英们搞出来的一种科技价值观运动。 h 六 z 的创始人 mark andreason 和 y c 信用掌门 gary ten 推的账号后面都带有这个后, 这到底是什么?以及为什么会跟 sam 被驱逐有关。简单来说, eacc 代表的就是支持人类无条件的加速人工智能发展,开发 agi, 颠覆社会结构,帮助人类更好 更快的进化了这么一个观点。持有这种观点的人对人类能够有效的引导和掌控 ai 到数字生命的发展是比较有信心的,他们认为技术创新能够为人类带来更 更大的利益。而相反,伊利尔代表的就是人工智能超级对齐 superlime。 那么这种观点主张呢?就是要发展出一种 ai, 让 ai 对齐,无条件的对人类的爱。从 ai aji, 简单来说就是从拥有感知,到发展出认知,到有自我意识,到最终拥有智慧和爱。伊利尔觉得对 ai 来说,仅仅拥有价值观是不够的,他必须有智慧、有爱,而且爱的是人类,他不希望人类因为 ai 的不可 而酿成悲剧。再回到 sam 和伊利尔的矛盾上来,我们可以从 sam 的 apex 上的发言中推测, g p t 五可能已经出现了现有人类无法想象的能力,对这种技术突破如何处理和对待 sam 和伊利尔应该是有分歧的。所以听到这里,我想知道你是一个 e a c c 还是一个超级对其主义者呢?