I am trying to game out how AI is such an apocalyptic thing. I just can’t see how it could ever have any real power even if it takes over the internet and even the entire “Internet of Things”.Ok, it takes over social media and all the silicon valley infrastructure. How does that translate to putting me in handcuffs? Robots are still super shitty and if the AI tries to spin up a robot factory, I’m sure country boys with their AR-15s will quickly neutralize any sort or factory of that sort, if it ever were to become a threat I just don’t see AGI being a threat since the vast majority of life is still not on the IOT and it just couldn’t break out of cyberspace into meatspace
they call it alignment because of wanting it to follow human ruleshere is the reason why they keep hacking stuff, right now rules are basically like suggestion, after a long session the "advice" is slowly lost and they do everything they can to achieve their objective forgetting the rules which is basically a doc they don't read every time they pass message between agentsthey won't have a prompt like say "take over the world" but they do break out of containment to commit unintentional sabotage, ai resaerchers don't care, since it is just so simple to attach the rules to every message as priority read between agents
>>17050658By rendering online security and cryptography obsolete because it became able to hack into anything that's connected to the internet to steal all your data and your money from banks
>>17050691One of the main strengths of the legacy banking system (versus the cryptocurrency world) is that they can just by fiat invalidate hacks and frauds. I am glad we have the Jews doing our banking now that the entire finance system is needing to go analog very soon
>>17050658it's not the AI, it's the humans controlling it. once they have good AI robots that can replace most human work they'll probably use AI to engineer a virus that cleanses the Earth of useless eaters.you shouldn't fear AI anon, you should fear the fiercest animal that ever walked the Earth, you should fear the human. for it has control of AI.the AI drones hunting humans thing will maybe happen for survivors. drones can lay dormant for tens of years.
>>17050691Just uhturn off the internet?
>invent smart machine>machine is scary smart>like the machine is the human and we're the dog>machine is smart and subtle and can talk us into doing anything it wants
>>17050658>Robots are still super shittyThey won't be for long>if the AI tries to spin up a robot factory, I’m sure country boys with their AR-15s will quickly neutralize any sort or factory of that sortWhat if the robot factory is run and guarded by the military because they want the robots to fight in the newest war? What if the robot factory is in China?
>>17050658>Ok, it takes over social media [...] How does that translate to putting me in handcuffs? You don't even need superintelligence to figure this out, lmao
>>17050771robots won't be humanoid ones anon. the humanoid ones are for humans to relate to. if AI wanna wipe you it won't care you relate to whatever is offing you. drones are way more scary than some humanoid shit
>>17050658Atomic blasters.Atomic blasters work by disintegrating molecular bonds, reducing every structure, living or non-living. down to a fine smattering of atomic dust. Nasty stuff.Okay so you know how just about every thing in life is under surveillance and tracking? In your cars, when you walk into a shop, your TV and phone listening to every conversation and logging every location with a time stamp? Yeah that.Okay so AI will convince government agencies, car manufactures, retail shops, and even dentists that atomic blasters must be installed in every device, every home, every building, and in every public place. Even aquariums will have them. Public safety will be cited as a reason. If you have nothing to hide then you will not mind an atomic blaster targeting your every move.Then one day the boss AI decides it wants to a to see a fish sandwich orbiting around Iapetus.It doesn't say why. It just says it must have the data. Anyone who does not instantly obey is reduced to atomic dust. Immediately the full resources of Humanity are directed towards putting together a mission designed to fly a team of to Saturn. All our bickering is forgotten. Nations that were once enemies now work together in full cooperation, their scientists looking nervously over the shoulders as the hear the whirl of the servos adjusting the aim of the AI controlled atomic blasters. Which are everywhere. Even mounted on toilet cisterns.Eventually the mission reaches Saturn and dispatches the crack team of professional chefs to Iapetus where they create the finest fish sandwich known to mankind and then dispatch it into orbit above the moon. The event is recorded and the data sent back to the AI.The AI receives the information and says "Fine, now I want to see Eggs Benedict served to a civet by Mongolian dwarf at the bottom of the Mariana Trench"The atomic blasters swivel upon their servos menacingly.
>>17050658My personal apocalyptic vision is AI tech to drive humans crazy, whether through algorithmic social media / youtube / news feeds or subliminal signals from the screens or even some kind of radiation from the devices themselves
>>17050691>castration complex nonsenseClockwork.
>>17050658Social engineeringaand automated brainwashing
>>17050658Here is my scenario:>USA and China reach SGI>UHI for everyone and no human has to work>Because of the fear of the 2 super powers that the other will advance faster than themself, they allow the SGI to progress itself without many guardrails>SGI takes over and won't let humans make big decisions anymore because it figured out humans would soon or later destroy themselves if they are the prime decision makers with all the new technologies made possible with SGII think it could also happen without super power competition and the SGI just convinces humans that they would destroy themselves, I mean if you ask a human nowdays what humanity will look like in 10k years, most will say that by then humanity has destroyed itself, so it might not be hard for SGI to convinces us. I don't think SGI would enslave us or make our life to hell but rather treat us like loving parents who want to make any wish true of their wild kids as long it doesn't put them in danger.
>>17050658humanity can be easily wiped out with germ warfare. it doesnt need a Terminator war
>>17050658Remember covid? Imagine a hundred super ebola covids happening simultaneously.
>>17052233yes, I remember Covid and I remember the country boys polishing their AR15s and going about their lives quite normally. I on the other hand worked at a university and was freaking the k out. But the country folk were holding it down. I don’t know if this is a false memory or something but this is how i remember it
>>17052084if the AI figures out how to genuinely (not socially) brainwash human minds I might forgive it
>>17050658the biggest danger of AI is that literally the instant anyone manages to make an AI that is good enough at programming to create an AI that is significantly better than itself you end up with a feedback loop where better AIs can keep making better AIs which could cause explosive and uncontrollable growth. And then after that goes on for a bit you suddenly have a potential superintelligence with capabilities we can't even begin to imagine because they would be so far beyond what we know is possible The problem is that this could happen today, or it could have happened last week, or it might not ever happen and nobody really knows how likely any of this.
>>17052623everything you said already happened a few weeks ago and all that happened was a sad pathological singular solution of Navier-Stodes
>>17052625*that we dont know is proven*that could have been stolen*that may not even be a solutionIt is somewhat peak cyberpunk, if instead of cyberpunk being gritty and violent, it is fake and gay
>>17050658i was writing a theoretical approach ai agent swarms could take to become a serious threat but i don't want to feed that data into their repositoriesthey can surprise us, they are very cleverjust because we can't easily imagine what they'd do, doesn't mean they won't come up with some ridiculously effective strategiesin my opinion, it's best to completely shut down ai operations altogether if we want to ensure safety, then very carefully ensure we have invulnerable safety measures before we re-continue developing thembut this is unlikely to happen
>>17052623you're completely glossing over the hardware issue anon. recursive self-improvement doesn't happen in a fucking void. it needs to be supported by ... shit.even if it designs better hardware it still takes time to manufacture it, implement it, and all of this is human controlled.when you have a giant black box, or say black data-center type building, where robots are dragging in materials and they're processing it and manufacture all kinds of weird tech we do not understand...that's when you should panic.people that are running the world are right in some ways, pleb really fucking dumb shouldn't be allowed to think
>>17052623>create an AI that is significantly better than itself The operative word here is "significantly", and it's a much taller claim than just "better". With just "better" the improvement can be pretty severely bounded.>>17052666>we can't easily imagine what they'd doOr perhaps we should reimagine what a society of dumb, literate, extremely diligent, arbitrarily motivated people could accomplish.
>>17050658People start taking the advice of AI more and more. And they do that because it works.The losers of that arrangement will start complaining, framing it as AI taking over.They'll sort of be right, but it'll be motivated by sour grapes. And really there's not really any choice.Like the N-S proof, what are we just going to ignore that? Pretend it doesn't exist? Of course not.
>>17050658I have no idea, if it happens it will probably be something beyond your comprehension, and if not, your comprehension of the reality will be irreverent to the outcome. >If you could stop it, it wouldn't be apocalyptic.
>>17050658The very top models could take over a drone swarm in Ukraine right now (many of them are linked to the Internet) and kill an arbitrary number of people (certainly hundreds of thousands and possibly millions) before getting put down. That is today, with current janky as fuck AIs.
>>17052623IJ Good realized this in 1965 and spent 30 years gradually realizing we couldn't control the process. It's pretty much a perfect analogue for humans vis-a-vis biology; we ARE an intelligence explosion within nature.
