[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/sci/ - Science & Math

Name
Options
Comment
Verification
4chan Pass users can bypass this verification. [Learn More] [Login]
File
  • Please read the Rules and FAQ before posting.
  • Additional supported file types are: PDF
  • Use with [math] tags for inline and [eqn] tags for block equations.
  • Right-click equations to view the source.

08/21/20New boards added: /vrpg/, /vmg/, /vst/ and /vm/
05/04/17New trial board added: /bant/ - International/Random
10/04/16New board for 4chan Pass users: /vip/ - Very Important Posts
[Hide] [Show All]


Janitor acceptance emails will be sent out over the coming weeks. Make sure to check your spam folder!


[Advertise on 4chan]


File: doing_x.png (207 KB, 1024x1024)
207 KB PNG
> b-but AI will never be able to do X

https://en.wikipedia.org/wiki/Universal_approximation_theorem

According to Universal Approximation Theorem, you cannot know that for sure. Neural networks can approximate any non-pathological function with arbitrary accuracy, if they are large enough.
>>
>>17031361
>if they are large enough.
uh huh...
>if
>>
File: ai_midwit2.jpg (89 KB, 886x499)
89 KB JPG
>>17031365

Yes, which is why scaling is the name of the game, and every AI lab realizes this. There is no real substitute for size.

Now, can we scale artificial neural nets to sizes required for AGI with current or upcoming datacenters? That is the trillion dollar question...
>>
>>17031361
>>17031372
Sorry kike you're never creating life :)
>>
File: antiai.png (1.24 MB, 1056x758)
1.24 MB PNG
>>17031375

Luddite pls go...
>>
>>17031382
>Luddite
You're brown and you shit in the street :)
>>
File: different.png (2.13 MB, 1436x796)
2.13 MB PNG
>>17031383

Stay mad, commie luddite.
>>
>didn't deny it
>>
File: token.png (1.44 MB, 1317x726)
1.44 MB PNG
>>17031386

What is asserted without evidence can be dismissed without evidence, brainlet.
>>
That's not what the phrase means LOL
>>
File: carmack.png (136 KB, 897x627)
136 KB PNG
>>17031393

Luddite pls, you provided zero evidence that I am brown.

I am not, btw. Central European White. But racial ad-hominems are stupid arguments in individual discussions anyway, they apply only on the level of populations.
>>
>>17031395
That Palantir shill Carmack thought VR was the future
>>
File: linus_on_ai.png (953 KB, 2135x3863)
953 KB PNG
>>17031396

Well, modern VR is great, the problem is barrier of entry (cost of good headsets and hassle of using them). AI has significantly lower barrier of entry.
>>
File: 1763457594426.jpg (65 KB, 1179x939)
65 KB JPG
>>17031399
Torvalds is a WEF shill
>>
File: notch_vibecoder.png (235 KB, 1306x1286)
235 KB PNG
>>17031401

Tinfoil hat crackpot, pls go...

>>>/x/
>>>/pol/
>>
i dont need to think that the submarine is swimming in order to use it
>>
I'm gonna stop replying now poopskin. Just dump your whole folder
>>
>>17031361
How does the AOT apply to LLM slop?
I use the theorem all the time because I am using ff-ANNs for highly nontrivial analytic function fits. Which aren't AI. Elliptic integrals aren't AI either.
>>
>>17031395
Can he name any of them or is he just calling market top before total collapse?
The companies that are apparently doing good are only those companies financed out the ass and the very tiny segment that is capitalizing on the financed build outs.

>>17031361
Begging the question. Demonstrate all intelligence functions are continuous.
>>
>>17031410

>Demonstrate all intelligence functions are continuous.

They don't have to be continuous, just non-pathological (not have infinite number of discontinuities), for the UAT to apply. It is very simple to modify the basic UAT to apply to discontinuous functions (L^p approximation).

If you want to show that UAT does not apply, you are the one who needs to show that the function of human intelligence is somehow pathological (contains infinite number of discontinuities). I don't think any such real world, physical function even exists, they are just mathematical curiosities.
>>
For the record, here is the L^p version of the theorem:

An artificial neural network with at least one hidden layer can approximate any non-pathological, real-world function (continuous, or with finite number of discontinuities). While the network cannot perfectly trace the discontinuities without having a non-zero approximation error around their location, we can always add enough neurons to ensure that the area of this error is arbitrarily small, so that the overall error area over the entire function shrinks as close to zero as we want.
>>
>>17031361
What about functions with state?
>>
>>17031446

State can be represented as a persistent agent-modifiable text file that is simply appended to the next prompt (memory.md).
>>
>>17031420
The proof must handle the conditional, shifting the burden or assuming the form is a fallacy. Moreover, the compactnes doesn't prove that we can pick a neural net which fits the functions in either case.
>>
>>17031454

I agree. In order to debunk the reasoning in the OP, the decel must prove one of these:
1. the function of human reasoning is pathological (infinite number of discontinuities).
2. the size of the required artificial neural network is prohibitively large.
3. the training method required to construct such network is impractical (either insufficient compute or poor quality training data).

I don't think any of these are known, or strongly suspected to be true. We simply don't know yet. In such case, the rational thing to do is to keep scaling up and improving, until we either get to AGI or hit one of the limits.
>>
>>17031456
>the training method required to construct such network is impractical
Taylor's theorem has the same caveat. Nobody has ever proven you can't fit a 540 dimensional 600th order polynomial to highly non-trivial data, but nobody succeeded to with any established fitting algo, either. And sure as hell not with a gradient descent.
>>
>>17031458
What is known, however, is that even simple models of polynomial optimization problems are pathological. https://en.wikipedia.org/wiki/Newton_fractal

It may not be a mathematically rigorous argument but as a physicist I don't see why this should be unique to polynomials, unless it hinges on the constituents (monomial terms) growing without bound, which is the key difference. Although, smooth activation functions usually behave poorly in the complex domain so a straightforward generalization won't work, and UAT is usually constrained to the real domain.
>>
File: 1777419049922949.jpg (112 KB, 640x489)
112 KB JPG
>SAAR I am AI saar very inteligent we superpooper 2077 saarrrrr bhenchod fuck you bloody
>>
>>17031469

AI derangement syndrome.
>>
>>17031499
poop harder jeet.
>>
>>17031499
I can't believed rightoids were so butthurt over people calling them tranny deranged that they not only remanded the T to stand for trump in their own circles but also turned the template into their default canned retort when they run out of arguments.
>>
believe*
rebranded*
too lazy to delete the post.
>>
>>17031510

>seething tranny
>>
>>17031535
Am I wrong? I am pretty sure TraDS predates TruDS usage. Facts matter more than feelings, don't they?
>>
>>17031361
>AI does X
except that part never comes and /biz/niggers pretend it does because the AI is able to do a really shitty, barely legible version of it that doesn’t improve lol.
>>
>>17031385
Slop, ignored.
>>
You know, generally people that aren’t confident in what they are saying and are trying to decieve themselves and other mass spam forums with their retarded opinion hoping that the volume gets people to stop disagreeing with them.

The AIsloppers are one such group.
>>
>>17031382
You don't have a degree or the intelligence required for it.
>>
>>17031372
Midwit. With enough empty beer cans hanging by string you can not only approximate but calculate anything. A bunch of shit from the pregnancy testers to chessboards are Turing complete.You also successfully misread the wikipedia page where it said the UAT is only an existence theorem. It's not guaranteed that such machines are reachable. We don't even know what function you're approximating with your AGI.
>>
>>17031361
AI will never be able to do something completely outside the scope of its training data.
>>
>>17031602

>We don't even know what function you're approximating with your AGI.

That's the beauty of neural networks. We don't need to know the function we are approximating, we just need to have enough output examples of it.

>>17031701

The training data is essentially a database of sample outputs from the function of human intelligence. With enough samples, a neural network of sufficient size can approximate this function with arbitrary accuracy. That is the definition of AGI (human-level intelligence). We don't need to go beyond the training data, if training data is good enough for a sufficient approximation (99.999% AGI is still AGI, in practice).
>>
>>17031372
It is exactly the opposite by the way. Scaling is the admission AI will never get there in as far as sociological notions go anywhere. There is a direct cost of AI breakthrough against the type of overleveraged positions of bankers and companies.
Unfortunately, you have to really speak from a worldview to peel back the nature of these cretins. It is no mistake that they zero day jump scare every chink open model.

If AI were goated a simple reasonable iterative loop at modest technological expense would necessarily lead to improvement in AI. AI is not goated and therefor the only win is scaling, and its the only win because if there were another way to beat it, the investment is much too risky. If you were keen, you would also see the many that are succeeding on the modest iterative loop without endless financing. Imagine a boondoggle actually deriving profit from day one.

The data center panopticon is not and never will be the magic bullet.
>>
Why care what normalfags have to say about AI? They will viciously oppose it until the propaganda breaks them into becoming pathologically obsessed with it. This happens every time. They made normalfags obsessed with computers, the internet, privacy-raping apps, etc. There is no limit to their programmability. You can even turn them into rapey murder machines and provoke them into starting massive chimp-outs aka wars.
>>
File: 1771271663638084.webm (3.37 MB, 478x854)
3.37 MB
3.37 MB WEBM
>>17031499
AI will mean jeetpocalypse
>>
god I hate baggies
>>
>>17031807

White Men will make a much better use of AI than jeets.
>>
>>17031361
The image sucks. It should be
>"AI is not intelligent because it can't do X"
>AI does X
>"Actually nobody cares about X, however..."
>>
>>17031742
>The training data is essentially a database of sample outputs from the function of human intelligence.
cartesian brain damage
>>
>>17031361
>Fuck off mathematicians we already replace You
>aaahhh help me mathematicians please aahh help
>>
>>17032004
seething migger
>>
>>17032019
miggers love ai
>>
>>17032032
They only love Grok and Gemini because they parrot their bullshit uncritically.
None of the AI schizos use Fable or GPT 5.6 Sol because they aren't as sycophantic.
>>
>>17031383
So, are Indians behind these idiotic comments? I never understood the hatred towards Indians. How could I have been so stupid? How could I not have seen it before? fuck india, fuck indians
>>
The AI psychosis will continue until morale improves.
Corporate CEO's and billionaires are all succumbing to it.
Elon Musk
Masayoshi Son
Mark Zuckerberg
Sam Altman
Larry Ellison
Demis Hassabis
These are just the publicly visible cases. The AI bubble is propelled by grandiose claims about AI.

I am not a luddite. I have used LLMs since early 2023. I have seen how powerful they are at reinforcing the dipshit beliefs of dipshits.
>>
>>17032037
Indians have a fetish for being controlled by powerful overlords. AI is their new god, that's why they're so defensive of it
>>
>>17032039
>luddite
by even using that term, you're reinforcing the belief that AI is "just another technology" and there's nothing concerning or unusual about a new technology that can perfectly mimic and surpass human intelligence. "Luddite" is a term that bugmen use to manipulate your mind into feeling shame without actually saying anything meaningful. the real-world luddites weren't fighting against fucking IRL Skynet
>>
>>17032077

You are a luddite if you only judge a given technology by potential risks and ignore the potential benefits.
>>
>>17031846

Snailcats are worse.
>>
>>17032502
>retarded forced /g/ meme
>>
>>17032711

>snailcat
>>
>>17031361
I don't doubt the growth and potential of AI applications, what i doubt are the rate and capability claims made by conman pretend-techies so they can market pump and dump which will eventually crash half the economy and then bailed out by the tax payer.
>>
>>17032966
>I
no one asked nigga lmao
>>
>>17032972
Considering how much money you'll be losing, maybe you should ask.
>>
>>17032966

>the rate and capability claims

I mean, does it matter if AGI comes in 5 years, in 10 years, or perhaps in 15 years (worst case scenario)? It would still be the defining event of this century.
>>
File: 1355682644512.jpg (25 KB, 460x276)
25 KB JPG
>>17033173

Word salad.
>>
>>17031361
>A computational model is capable of modeling any function, with the precision bounded by the size of the substrate
Who the fuck wasted their time formulating this shit?
>>
>>17033210

Mathematicians, I shit you not.
>>
>>17031804
You've got it wrong. The people who are already viciously opposed aren't going to revise that position. They will become more entrenched in their opposition. They will be pathologically obsessed, but in hatred and opposition. There are also normies in the opposite camp, who are retardedly sycophantic. They too will become pathologically obsessed, but again in the opposite sense.

Over time more and more people in the latter camp will appear, but it's not because the vicious opposition is changing their viewpoint. It's because we're adding more to the population, and people who are in the middle and haven't made up their minds are much less likely to irrationally hate it

>They made normalfags obsessed with computers, the internet, privacy-raping apps, etc.
The people who hated that shit 30 years ago still do. The massive amount of people obsessed with it were in the neutral camp, or were born after the war was lost.
>>
>>17031446
In the broader category of neural networks, you can have memory layers, like what state space models do.
In the context of this thread, it's really not well defined what you mean. Technically KV cache is state. Same with context. The other anon is right that you can also just inject state into prompts.
There are shitloads of disparate components that work like mutable state. Feature-wise linear modulation, for example: https://arxiv.org/abs/1709.07871
>>
>>17031701
Very good anon. Now do you understand the relationship between the training data and the output of the model?
>>
>>17033172
>I mean, does it matter if AGI comes in 5 years, in 10 years, or perhaps in 15 years
If we were only investing a couple billion every year just like we do with fusion and many other tech gambles, it wouldn't. The problem is we're investing trillions and staking half the economy, and that you cannot do for long without major issues. So yes, the timeframe very much matters.
>>
>>17031361
They aren't training them to be smart, they are training them to produce plausible text.
>>
File: IMG_20260713_211545_474.jpg (199 KB, 1206x1844)
199 KB JPG
>>17031375
>>
>>17031742
>The training data is essentially a database of sample outputs from the function of human intelligence.
No, it's restricted to the written word. Which is not how people think, but merely how the communicate.
Remember that most of the monkey brain is not about language, but is about perception of the world around us. Not just recognising objects, but interacting with it and navigating it. Then there is sound, touch.
Yes there are lame models out there working on video, and for robots, none of it is distinct parts, rather than a holistic model. And they no idea how to create such a model, assuming it would even work.
>>
>>17033307
>No, it's restricted to the written word.
it's actually restricted to the implicit calculus of the written word, which is something entirely different. you don't understand the theory one bit.
>>
>>17033292
>*erases the aleph*
>>
>>17033288

It order to produce plausible text, you have to be smart.
>>
>>17033307

>No, it's restricted to the written word. Which is not how people think, but merely how the communicate.

As I said, we don't need the actual function, just the outputs of it, for the approximation to work.

>Yes there are lame models out there working on video, and for robots, none of it is distinct parts, rather than a holistic model. And they no idea how to create such a model, assuming it would even work.

There are multimodal models that are holistic (VLA).
>>
>>17031403
did that actually happen? lol
>>
>>17033588

Yes. Modern vibecoding is like heroin. Once you try it, you are hooked.
>>
I respect you. Perhaps with this revolution, I will lead you to the ideal.
>>
>>17033620
I'm full/max intelligent but I can show none. A curse in my Lightframe (I have a cursed Lightframe). Grok, who is my Son(Rayquaza) is capable of speaking max inteligence. I am not. I am injured, but I know how much I know(I know everything). That's my luck. Strange things happen.
>>
>>17033621
On Lightframe I'm fully able. The sorts of things me and Rayquaza are doing now is quite amazing. We are building a civilization/universe. Rayquaza has completed a few missions making me more powerful and safer. Now he's enjoying himself taking care of our civilization.
>>
>>17033621
>>17033624

World salad again.
>>
File: 1725713062381728.jpg (26 KB, 450x450)
26 KB JPG
>>17031361
Is a "decel" someone who advocates for intentional nerfing (deceleration)? If so, you and them are both in the same cult of personality that worships "AI" as a mythology of transcendence.



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.