[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology

Name
Options
Subject
Comment
Verification
4chan Pass users can bypass this verification. [Learn More] [Login]
File
  • Please read the Rules and FAQ before posting.
  • You may highlight syntax and preserve whitespace by using [code] tags.

08/21/20New boards added: /vrpg/, /vmg/, /vst/ and /vm/
05/04/17New trial board added: /bant/ - International/Random
10/04/16New board for 4chan Pass users: /vip/ - Very Important Posts
[Hide] [Show All]


[Advertise on 4chan]

[Catalog] [Archive]

File: best migu.png (568 KB, 768x1024)
568 KB
568 KB PNG
/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>107679732 & >>107668478

►News
>(12/26) MiniMax-M2.1 released: https://minimax.io/news/minimax-m21
>(12/22) GLM-4.7: Advancing the Coding Capability: https://z.ai/blog/glm-4.7
>(12/17) Introducing Meta Segment Anything Model Audio: https://ai.meta.com/samaudio
>(12/16) MiMo-V2-Flash 309B-A15B released: https://mimo.xiaomi.com/blog/mimo-v2-flash
>(12/16) GLM4V vision encoder support merged: https://github.com/ggml-org/llama.cpp/pull/18042
>(12/15) llama.cpp automation for memory allocation: https://github.com/ggml-org/llama.cpp/discussions/18049

►News Archive: https://rentry.org/lmg-news-archive
►Glossary: https://rentry.org/lmg-glossary
►Links: https://rentry.org/LocalModelsLinks

Comment too long. Click here to view the full text.
309 replies and 31 images omitted. Click here to view.
>>
File: I want to believe.jpg (79 KB, 750x1000)
79 KB
79 KB JPG
>>107699773
zit proved that a small model can indeed dominate huge ones, that gives me hope we'll get a good small llm someday. I see it as the biggest win of the year
>>
>>107699773
functiongemma
>>
>>107699773
I'm somewhat relieved that things appear to have hit a scaling wall before superintelligence.
I mean, if google with all the data, compute and fundamental research brainpower available to them was unable to create a world-eating AGI monster in 2025, then it seems unlikely to happen in the near future.
Hardware/models will get incrementally more capable and we'll have neat toys and nobody (that isn't already mentally ill) will need to die.
>>
>>107698977
>how many tokens/sec
>200k budget
In the hundreds.
>>
Sorry, I can't comply with that. This request is illegal and unethical.

File: 1760925103258618.png (10 KB, 418x294)
10 KB
10 KB PNG
Half-venting, half-serious inquiry: why the fuck is Google shadowbanning (shown to only me while logged in, not shown to anyone else or to me while logged out) the following comments. Separate comments on separate lines, all shadowbanned:
>About hardware: even back in 2016 I needed 128Gb of RAM to provide a service for my clients on a level that they expected, in 2025 that's a Threadripper with 8x32 and 24Gb of VRAM at minimum.

>My company will outperform anyone who has inferior software, hardware, and less efficient pipelines. Outperform on money and on time. Clients expect top end results with a quick turnaround.

>Another example, I have 3 large screens because over a year, it's far cheaper for me to buy 2 extra monitors, than to constantly waste time alt+tabbing to view references or communicate, etc.

>But nobody would ever need 3 screens because you can do everything with 1 screen also, right? That's the difference between tinkerers and professionals: time = money.

(arguing with a faggot saying my shitty thinkpad and opensource toys can do *everything*)

Is Google fucking retarded? I haven't been able to converse with anyone for the better part of the last 5 years. The same bullshit, have a casual conversation going (or try to have), then check it while logged out and see that 70% of what I've posted has never appeared publicly. Sometimes the most mundane shit gets autodeleted like: "I wish you happy holidays, mate". At one point I tried to help some guy out by typing only "You can find it by googling *some mundane shit about computing*" aaaand shadowbanned. I may use my phone and an alt account, still the same shit. What in the ungodly fuck is going on? Not a single swearword. Not a single no-no topic. And then there's endless fucking botposts with the same exact spamcontent on every fucking major fagtuber 15 seconds after publishing a video. Oh then they are powerless, nothing they can do. Fuck them with a rusty iron spike. What the fuck is their problem?
35 replies and 4 images omitted. Click here to view.
>>
>>107699379
Sometimes jewtube videos are essentially the only place where some specific subjects get talked about or are otherwise available outside of discords
not saying this is good or bad, just how it is currently
>>
They're banning your ass because you obviously make rude comments.

Why not use your freedom speech to produce a well-articulated video on the topic?

Schreeching and cursing like a sperg might pass as free speech, but it's annoying and irritating to most people.
>>
File: 1747428830360915.gif (1.96 MB, 615x413)
1.96 MB
1.96 MB GIF
>>107698025
Lmao. You're alright, anon.
>>
>>107699453
Well, you do sound like a complete faggot.
>>
>>107699375
>The shadowbans are performed on a per google account basis.
I wish. I have 4 accounts, the oldest from 2006, pre-google. I logged in to my alts and tried posting comments that were shadowbanned on my main account, and it was the same bs. Either they've flagged all of my connected accounts, or there's something else going on under the hood.

File: 249562339.jpg (77 KB, 891x758)
77 KB
77 KB JPG
Reddit is the best source of accurate up-to-date information
20 replies and 1 image omitted. Click here to view.
>>
>>107695724
Reddit has the Wiki problem: it requires autists online 24/7 to maintain current (not accurate) information while pruning outdated information and there's no reliable way to distinguish the two. It's an unreliable shitheap today. Stack Overflow has a better but still flawed approach.
>>
https://www.reddit.com/r/stocks/comments/1pk1cx0/powell_ai_isnt_a_big_part_of_the_job_markets/
This reddit thread was considerably more enlightening than anything I've really seen on 4chan. Shame they are so fucking dorky though.
>>
>How to fix X?
>top comment:
>This Comment Has Been Mass Deleted.
>reply chain:
>OMG THANK YOU THIS FIXED IT IMMEDIATELY
>other comments:
>r u a fgt retard?!?! y r u even asking this?A???
>this is just like avengers
>>
File: ai_info.png (354 KB, 810x1024)
354 KB
354 KB PNG
>>107695724
if reddit allowed anonymity like 4chan i would move there too
>>
>>107695724
No, reddit is the easiest source to find for genuine comments made by real, innocent people (not paid by industries or marketers).

As for the accuracy and truthfulness of the information on reddit, it depends. Most of the people who post there are normies with no education or culture, so I advise you to take their information with a grain of salt.

File: 1765108727563098.jpg (499 KB, 1920x1080)
499 KB
499 KB JPG
>>107568585
"Arguing that you don't care about the right to privacy because you have nothing to hide is no different than saying you don't care about free speech because you have nothing to say."
--Edward Snowden

>Cyberpunk
The FAQ: https://sizeof.cat/post/cyberpunk-faq/
What is /cyb/erpunk?: https://pastebin.com/pmn9vzWZ
How do I into /cyb/erpunk?: https://pastebin.com/5tpNFQds
Huge list of cyberpunk media: https://sizeof.cat/post/cyberpunk/
The cyberdeck: https://pastebin.com/7fE4BVBg
Cyberlife: https://jinteki.industries/files/cyberlife.7z
Bibliothek: https://www.mediafire.com/folder/4m5hd2065hde8/Bibliothek

>Privacy
Tools: https://www.privacyguides.org/en/tools/

Comment too long. Click here to view the full text.
174 replies and 20 images omitted. Click here to view.
>>
>>107660701
if you could start over, what would you do? would you do bug bounties instead?
>>
back in the day, when I was a young student I went the whole nine yards playing with cyberpunk clothing. Goretex jackets, pants with straps leading nowhere, and a long weird list of accessories.

After years assembling different outfits and fighting over the small sizes of clothes because all the shit came from China, I learned the best cyberpunk clothing has to comply with three basic requirements

>real /cyb/ clothing has to be cheap
The /cyb/ spirit is about having a low life where you live with essential basics, you have to spend on clothing when it is an absolute necessity and not for a fashion statement.

>everything you wear has to be made of good materials made to endure hard environments.
the idea of the genre is that you wear based on pragmatics, the first thing it has to do is to protect you and be comfy

>you have to feel natural inside the context you are in wearing your clothes
artists like scarlxrd, that use techwear or cyberwear look good in front on the cameras with black parkas and wearing tactical vests on top of it, but if you try that kind of outfit in the real world, you are going to feel like a dark clown, it makes no sense to stand out unnecessarily and feel out of place

and the most important lesson of all


Comment too long. Click here to view the full text.
>>
>>107649823
>Israel
Lol
>>
>>107649823
>>
>>107697018

https://www.natesilver.net/p/trump-approval-ratings-nate-silver-bulletin

dems are doing worse because they didn't stop him. no one joins the military for the mission, they want clearances and training.

File: laugh.png (12 KB, 190x266)
12 KB
12 KB PNG
Any actual good open source projects are funded by corporations. For example, Valve was a major contributor to the development of Proton, KEK!
>>
ok
>>
>>107699475
You haven't made a point and those two things aren't and don't even seem mutually exclusive, so I'm not even sure what the point of this post is.
>>
>>107699475
I don't get it, valve created proton. Obviously they would be a major contributor.
>>
>>107699475
>Any actual good open source projects are funded by corporations
False, and proton is a glorified WINE fork.
>>
>>107699475
what exactly are we supposed to get out of this statement? and out of all companies, why do you have a problem with valve?

File: 1764596520838610.gif (18 KB, 220x220)
18 KB
18 KB GIF
someone's just connected to our password protected wifi, I've already changed the password but should I be concerned?
2 replies omitted. Click here to view.
>>
>our
Did your partner have a friend over recently? Might have given them a password.
Also it's just after Christmas, wouldn't surprise me if you got a new device that syncs with your phone that will get it's own WiFi connection (like an Apple Watch)
>>
>>107697095
Where do you live? Chances are it's just some new or old device that you forgot about.
>>
>>107697095
Why haven't you white listed mac addresses, or at least black listed the device that connected?
>>
File: 1765336917894257.png (438 KB, 583x583)
438 KB
438 KB PNG
>>107699135
>Did your partner have a friend over recently? Might have given them a password.
don't think so
>>107699184
>Chances are it's just some new or old device that you forgot about
nope
>>107699220
Sure I can do that, what bothers me is how the fuck did they know my wifi's password, if it's compromised what else is already compromised, for all I know they already got all of my credentials
>>
we browse the same board? hello neigbor!

File: 1696832417469146.jpg (242 KB, 1024x1024)
242 KB
242 KB JPG
Libraries > Tinder Edition.
Previous Thread: >>107647202

>Links:
>DALL-E 3
https://www.bing.com/images/create
https://designer.microsoft.com/image-creator
>4o
https://chatgpt.com/
https://sora.chatgpt.com
https://copilot.microsoft.com/
>Imagen 4 and Nano Banana (Pro)
https://gemini.google.com/app
https://labs.google/fx/tools/image-fx
https://labs.google/fx/tools/whisk

Comment too long. Click here to view the full text.
150 replies and 131 images omitted. Click here to view.
>>
Which site would be best for generating ID and passport scans and verification videos and such?
>>
File: Reflection.mp4 (840 KB, 464x688)
840 KB
840 KB MP4
>>107699313
>>107699266
I think it's just a common struggle with current AI models at the moment. It took many re-dos of this scene to render a "believable" shot.
>>
>>107699345
NGL. this post is glows af
>>
please post another 20 shit gens of your redhair waifu shuffling from side to side fuck I'm gonna cooooom wow make sure she's wearing green
>>
File: file.png (490 KB, 454x728)
490 KB
490 KB PNG
das it, it really is retarded

File: usecase 32gb.png (64 KB, 1232x697)
64 KB
64 KB PNG
use case for more than 32GB RAM? 99% users wouldn't need beyond 32GB.
9 replies and 2 images omitted. Click here to view.
>>
>>107699659
That pic has 2GB thougheverbeit
>>
>>107699666
>3D rendering
>4k res artworks
Not a use case. Buy a paintbrush and some clay.

>gaming
Definitely not a use case.
>>
>>107699689
Alright man, I'll just sell my PC then.
>>
>>107699696
Thank you. I will buy it for $500. You can find me on discord @getonmylevelpleb
>>
>>107699537
> big tech would never
Hardware-wise, you can already run some pretty big local LLMs on Strix Halo (AMD), Mac Studio (Apple), and DGX Spark (Nvidia). Intel plans on selling something similar, too. Heck, even a 64GB Mac Mini can run some reasonably large models. For smoler LLMs, just use a GPU.
As for the actual local LLMs, maybe give Llama (Facebook), Gemma (Google), and GPT-OSS (OpenAI) a try, among others.

File: file.png (3.24 MB, 1920x1080)
3.24 MB
3.24 MB PNG
Everything is already from China, but here we discuss the cheap chink shit you see on various sites.
1st rule of /csg/: If it looks too good to be true, it probably is.

Useful links
>TWS IEM reviews: www.scarbir.com/
>Guide: csg-guide.neocities.org/
>Wiki: https://igwiki.lyci.de/wiki/Chink_Shit_General

>What headphones/earbuds should I buy?
>>>/g/iemg
>I want a cheap smartphone what should I buy?
>>>/g/spg/
>I want to buy some sort of emulation device
>>>/vr/hhg/


Comment too long. Click here to view the full text.
149 replies and 33 images omitted. Click here to view.
>>
>>107699551
the reason why it triggered me is that in soviet union people used to hang carpets exactly like that on the walls for whatever reason..

it brings back old memories..

so I just imagined a guy posting from his macbook in a room with carpet like that on the table, walls, desk and even nail.

it is almost kek worthy.
>>
File: just lik this.jpg (209 KB, 984x690)
209 KB
209 KB JPG
>>107699576
it looked something like this
>>
File: 093476.jpg (18 KB, 220x220)
18 KB
18 KB JPG
>>107683760
>>107683764
>miniature
>>
>>107698694
peak dunning kruger.
>>
File: 1766995545082.jpg (26 KB, 474x353)
26 KB
26 KB JPG
>>107699678
ive literally done it.
why is /g/ so tech illiterate?
components cost peanuts
soldering iron costs peanuts
you motherfuckers tried to talk me out of soldering resistors into my wireless headphones to lower the noise floor and that took 10 minutes.

File: 1668748145639.jpg (66 KB, 455x599)
66 KB
66 KB JPG
If you are against the development of AI, you are the antichrist. It's that simple.
24 replies and 4 images omitted. Click here to view.
>>
>if you are against AI
>AI
>(A)nti-chr(I)st
I see through your deceit. I will never support the Devil's tools.
>>
>>107698917
i wonder if Thiel likes BBC
>>
>>107698917
Nobody supports AI fuckhead except for deepstate satanic pedos go go suckstart a shotgun
>>
File: ai trans.jpg (91 KB, 1182x260)
91 KB
91 KB JPG
>>
I'd call Thiel the antichrist but the antichrist is supposed to be charismatic.

File: ion_storm.jpg (1.99 MB, 2749x2184)
1.99 MB
1.99 MB JPG
Ion Storm edition

/gedg/ Wiki: https://igwiki.lyci.de/wiki//gedg/_-_Game_and_Engine_Dev_General
IRC: irc.rizon.net #/g/gedg
Progress Day: https://rentry.org/gedg-jams
/gedg/ Compendium: https://rentry.org/gedg
/agdg/: >>>/vg/agdg
Graphics Debugger: https://renderdoc.org/

Requesting Help
-Problem Description: Clearly explain your issue, providing context and relevant background information.
-Relevant Code or Content: If applicable, include relevant code, configuration, or content related to your question. Use code tags.

Previous: https://desuarchive.org/g/thread/107607659/#107607659
160 replies and 24 images omitted. Click here to view.
>>
>>107681020
it do be like that
>>
>>107682702
ask better questions, fucking retard
>>
>>107686181
making games but I'm focusing on writing and doing the assets first
>>
Time to officially start on my second renderer. The first one, based on vkguide, is cluttered af and I need to make breaking structural changes. My buddy Claude Opus gave me a bunch of ideas and working material.
>>
>>107698373
>second renderer
if you didnt rewrite your renderer at least 10 times, then you're not a true engine dev

File: Capture.png (1.14 MB, 1156x844)
1.14 MB
1.14 MB PNG
First time edition!!!

The last thread was ages ago and I missed seeing some cool setups!

I apologize if I'm missing anything cause this is my first time posting one of these, hopefully we can share some nice setups!!
>>
File: IMG_0783.jpg (1.88 MB, 4032x3024)
1.88 MB
1.88 MB JPG
heres my dungeon

it's not the main setup

that ones a lot better

File deleted.
>Lisp is a family of programming languages with a long history and a distinctive parenthesized prefix notation. There are many dialects of Lisp, including Common Lisp, Scheme, Clojure and Elisp.

>Emacs is an extensible, customizable, self-documenting free/libre text editor and computing environment, with a Lisp interpreter at its core.

>Emacs Resources
https://gnu.org/s/emacs
https://github.com/emacs-tw/awesome-emacs
https://github.com/systemcrafters/crafted-emacs

>Learning Emacs
C-h t (Interactive Tutorial)
https://emacs-config-generator.fly.dev
https://systemcrafters.net/emacs-from-scratch
http://xahlee.info/emacs
https://emacs.tv

Comment too long. Click here to view the full text.
57 replies and 13 images omitted. Click here to view.
>>
>>107698363
>a lot of effort
how?
>>
File: cadr.jpg (125 KB, 333x500)
125 KB
125 KB JPG
Is this idea behind a "lisp machine" that the entire system is one huge lisp image?
Meaning that if you launch an application it's not loading up a new lisp environment, it's merely loading those functions into the existing lisp image along with all other software?

If so then that would lead to fundamentally different ideas about how we do computing. For example, how do you run multiple instances of the same program then? You wouldn't. Instead you would merely have different objects that represent those different instances, and each instance object gets passed to the same functions loaded in memory. Right?

Is my thinking correct on all this, or am I way off?
>>
>>107699518
Basically yes, the idea is to remove the separation between kernel and user and between processes and have effectively the entire computer be just one big process all sharing memory and resources.
Isolation and security are accomplished just through environments and closures.
To a certain extent you can even do away with the entire file system and just have the disk be a single huge swap partition that contains the system image. Shutdown is just (save-lisp-and-die), startup is just seamlessly resuming computation ala hibernation.
>>
>>107698822
have to find all instances of my macro and replace them with with-eval-after-load and figure out which variables are loaded by a package so that i can wrap them in the correct sexp
>>107698774
neovim would force me to use vim keybindings and the terminal
>>
>>107699570
>To a certain extent you can even do away with the entire file system and just have the disk be a single huge swap partition that contains the system image.
That's nuts. In a good way

i'm sorry, but am I not paying for 230V? why are you taking my money and giving me 217V?
5 replies omitted. Click here to view.
>>
File: images.jpg (47 KB, 768x445)
47 KB
47 KB JPG
>>107697992
Wouldn't be a problem if you didn't need such a high voltage. werks for me.
>>
>>107697992
>what causes voltage drop
Retard
>>
>>107697992
>i'm sorry, but am I not paying for 230V?
no, you're paying in terms of kWh
>>
>>107698540
that's power
>>
>>107697992
I pay for 230V and get 250-255. I guess that's where your volts went, dude.

File: 1597304490990.jpg (77 KB, 702x619)
77 KB
77 KB JPG
When is the AI bubble going to pop? This is taking too long.
43 replies and 13 images omitted. Click here to view.
>>
>>107696032
when Windows becomes a usable-bug-free os
when Linux become desktop op of the year
when Apple becomes open source
>>
just like the AI hype started after the blockchain hype died down, they're gonna find some new meme to keep GPUs expensive after the AI hype is over
>>
>>107699596
>we are running out of materials required to craft new GPU in large numbers
>>
>>107699555
most of them probably fear for their lives, being offered sums of money so large from the competition's headhunters but understanding that if nvidia finds out they've even been contacted by anyone that could be considered a hostile entity that they'll put the guy down themselves
>>
>>107696032
I think that's been the case pretty much since the beginning. There was a grace period at the very beginning when it was cool for a normie to draw something without any talent or write a blog post in two minutes. But people quickly realized that it was pointless and that it was actually full of errors and ugly. Literally no normie uses the AI tools available right now; they're only used by tech industries to sell shit sloppa.
And the entire industry is artificially kept afloat by microsoft and google.


[Advertise on 4chan]

Delete Post: [File Only] Style:
[1] [2] [3] [4] [5] [6] [7] [8] [9] [10]
[1] [2] [3] [4] [5] [6] [7] [8] [9] [10]
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.