[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
▼ Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: HU4Bpw9XoAIjPm2.jpg (177 KB, 1562x1298)
177 KB JPG
VIBEcoded kernel gave a 3T param model 2x speed increase
>>
>>110101928
ok.
>>
>>110101928
don’t believe you, bullshit
>>
2x speed-up for a 3T param model? how did they get 2.5x speed-up for a 5T param model? I didn't even know there's 7T param models already, how did they get a 3x speed-up for it?
>>
>>110102073
Larger models (especially in the multi-trillion-parameter regime) often see higher relative speedups from the same class of systems/software/hardware optimizations because fixed or poorly scaling overheads become a smaller fraction of total runtime, while compute intensity and utilization improve.
>>
Anyone used this to increase the speed of a Bitcoin mining software?
>>
>>110102570
why would anyone tell you if they did
>>
File: 1792040934864272.jpg (25 KB, 620x306)
25 KB JPG
>>110101928
*cuck coded, also this won't stop the AI bubble from popping
>>
>>110102570
Figure that yourself
>>
>>110102649
>>110102687
Fair enough
>>
>>110101928
the y-axis shows each speedup being significantly more expensive to compute per token. what's going on here exactly?
>>
File: smile.png (10 KB, 503x408)
10 KB PNG
haha I though with my background in systems and ML I could get that kind of job when I graduate
>>
>>110105395
you just described what's going on
>>
>>110101928
WE WON, VIBEGODS



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.