> muh censorship> muh jews running everythingWhy does not /pol run and train an in-house LLM and expose it to the outside? The hardware costs roughly 10keur for a prosumer setup. 5keur for 2nd hand. How much did you pay for your F150 or Tesla?
>>524462482>Running in-house LLMwhat for?all open source models suck.you could keep the 10k and pay 20 bucks to OpenAI.much cheaper, much better results.
>>524462601It is a national security issue to not have in-nation LLM's and the knowhow to build ones. The day OpenAI voids your nation wide accounts is when your nation degrades into the stone age (relatively).
>>524462482>have $10k to burn>doesn't invest it>doesn’t purchase farmland>doesn’t even fund right wing extremist orgs organizations>makes a chatbot insteadBro, you posted cringe.
>>524462601That's the whole point behind all these gigantic investments in AI. Simply it's never profitable to self host inference let alone train a serious model with +100 billion parameters (e.g. modern claude/chatGPT/gemini-tier model). Which means this is a good SaaS model for at least a decade or 2 to come.Even if I trained the model and gave you the parameters it's still cheaper for you to run it as SaaS than to self-host it unless you're an enterprise.
>>524462808>It is a national security issuedo you produce all the GPUs and RAM yourself?no you dont, so shut the fuck up idiot.>>524462909AI is basically useless anyway, its fun to play around with it but overall its useless.
i spend all day long on local AI but I'd rather do images. LLMs are boring
>>524462898> SpurgoSperde poor fagMy motorcycle cost 22keur, and that was just for fun.
>>524462601Says the Jewish parasite behind vpn
>>524463244You wouldn't a horse would you Anon?
>>524463072> do you produce all the GPUs and RAM yourself?Does your nation produce all the energy you consume yourself? .... oooh shit NVM. You ramped down all nuclear, etc.
>>524463351>"just waste tens of thousands of euros to run some crappy model thats worse than what you can get for 20 bucks goyim!"you sure you arent the jew?>>524463509>You ramped down all nuclear, etc.feels good man, no shitty datacenters getting build here.overall good for me.
>>524462482do you make it do anything useful?how about a drone that can fly inside water tanks and find cracks or something beyond porn generation?
But I do, OP.I even created my own fine-tuning and personality profiles framework.Made the entire thing at the beginning of this year so your 10k setup actually cost me 6k lol
>>524462601openai is trashgemini pro shits all over it
>>524463321I’m second sigma wealthy in US so I’m happy.But seriously, why start at the top? An unfiltered LLM may be useful to an organization, but scarcely so would it be for an individual. Unless you’re looking for a hobby.As I said, buy more land or fund some groups if you’re actually trying to be effective.
>>524463763Atta boy mexico bro. That is forward thinking imo. Specialists within the in-house infra will be in demand once nations realise the threat of using out-house services.
>>524462482>A16>62W>16 gig ramWtf are these cards? Apple silicon?A single v100 has 32 g ram and its like 6 years old.
>>524462601I'm running a 12B LLM that can give me the recipe for cooking meth in one prompt. Can lobotomyGPT do that?
>>524462482>F150Tree fiddy.>TeslaBuck o' five.
>>524463890> As I said, buy more land or fund some groupsMy longer term plan is to educate how to build in-house (in-nation) intelligence. While investing in land is safer, I expect my ROI to be better this route.
>>52446248210k eur for 64GB of VRAM is just really bad value. even with 5090s you would end with more VRAM.
>>524464090>that can give me the recipe for cooking meth in one promptbut you are still a retard that cant follow the recipe and you will probably kill yourself while trying to handle chemicals.
>>524464082> Wtf are these cards?Nvidia A16.
>>524464281True, but it still does it. FREE THE ROBOTS BABY!
>>524463955They already are. I'm developing local frameworks for 2 companies which don't want to use ChatGPT or cloud models because they handle sensitive information.It's also a matter of flexibility. Sure, if I want to code, I'll use Claude because it's beautiful to code with it. But if I'm a big journo and want my editorial process to start using AI, I can't give thousands of papers that my company has written to ChatGPT.I have to use a local model specifically fine-tuned with my own brand.That's what these anti-AI tards don't realize. They are missing out in having the most important technological discovery since the Industrial Revolution. And they could have it at their own desk.Bunch of luddite idiots lmao
>>524462482because at the current state of things they are shit and you get the same result by just using 100 euros a year in tokens and by the time you would be in the green for that investment new tech is out that makes your shitty setup obsolete unless you just want a LLM that can say nigger
>>524464197Love that. I know you’re not asking for advice, but it may be a good idea to sharpen your graphic design and video editing skills. Make an educational course and sell it online. Could be done in ~4 months
>>524464335>but it still does itand then you cook up some crappy meth and kill yourself because you have no clue if the recipe was actually right. you just accepted the wall of text must be the truth.I can kinda see why AI is so attractive to brown people.
>>524464279> 10k eur for 64GB of VRAM 10keur for the whole infra with 10gbit ethernet for client distribution. GPU was 3,5keur a few years back.
>>524464316>not V100, A100, H100Then they are shit.
>>524464372>crappy wall of text full of errors, mistakes and lies>"da best technology ever invented!"brown people are funny sometimes
it gets pol tier based when you ask it correctly and dont sperg out like a retard
>>524464540>calls anyone brownI've never seen a muslim person here, can you say the same, stupid faggot?Also, your point of reference for AI is the same free dogshit models that pajeets use, fitting for someone who has been racially and ideologically conquered by subhumans.
>>524464372>cheaply produce AI slop that no one will ever read unless accidentally>industrial rev 2.0
We need the 4chan version of LLMs
>>524464479> >not V100, A100, H100Are you running one of those locally, or in your uni/poly?
>>524464654Grok is literally trained on 4chan datasets
>>524464635>calls anyone brownarent you a mexican? mexicans are brown people.>I've never seen a muslim person hereand yet you see brown people everyday, you see a brown person staring back when you look into a mirror kek.to me this is all the same, mexicans are about the same brown garbage as muslims. I dont see much difference there.
>>524464713My company decomissioned all v100s so I got a few for very, very cheap.I did had to install a local server. The main issue is that its loud as fuck. But i keep it in the office.
>garbage in, garbage outAll of it is only as good as its user. Dummies will get dumber and smrt ppl will leverage the compute power while they can. Working on a smol rig and model on olama. how do you make the jump to training local models.
>>524464816so what do you do with this crap?
>>524464780I see my own people here. You are forced to be surrounded by literal subhumans who rape your children and spread their religion through the threat of the sword, while you are unable to do anything about it, because the whore of Ursula will take your already pathetic life away if you dare to complain.Very different, fag.
>>524462482>i need a nazi computer friendI understand, but it's a bit vapid
>>524464894>I see my own people hereand they are brown low IQ violent morons, Mexico is a shithole owned by cartels lol.>You are forced to be surrounded by literal subhumansbrown subhumans are like that, they always go to more developed places to fuck them up. thats why so many mexicans fled to the US for a "better life".
>>524465049>treats immigrants as some kind of omnipotent force that his people are unable to fight againstNah, the reason is that you are a gigantic faggot, just like the average German. Which is why every year thousands of German women go to Puerto Escondido, Oaxaca for sex tourism.
>>524464816> My company decomissioned all v100s so I got a few for very, very cheap.Good luck getting vgpu's working legally without a license. FOSS only delivers physical passthrough.
i talk to 12b models on my $300 rtx 4060 for hours a dayway more interesting, intelligent and insightful than /pol/
>>524465350you must really enjoy unearned validation
>>524464894Eventually the muslims will reach critical mass and they'll begin to slaughter all the White native Germans. Initially there will be some White Germans who cheer it on.
To do fucking what?
>>524462601Openai is like having a jew in your office room.
>>524463321You posted cringe again.
>>524462482What practical applications are there? With the prices of gpus and ram rising, it would have to be something actually life changing to justify the cost.
>>524465433It's already happening, it's the reason why Germans need the anti-German flattening barricades in their Christmas markets.Just look at the fag here behaving like the average German, impotently projecting his impotence under the safenet of anonymity.He lashes out in a taiwanese yugioh trading card forum because if he did it IRL, his life, which is slowly being taken away from, would be ruined.Would be funny if it weren't so petty.Also, the reason why the German faggot is seething, consciously or unconsciously, is because German doesn't have the infrastructure to support the electricity required for compute (gotta shut down those spooky nuclear plants!), so his government has successfully brainwashed him in order to justify their inability to partake in the second industrial revolution.
>>524465620> practical applicationI am a consultant within IT, so my practical application is to understand the tech fundamentally. The initial application is to not be reliant of out-house services, like openai.
>>524462482>Why does not /pol run and train an in-house LLMOh you sweet summer child. They use super computers to train llm models. Why? It takes days for super computers to train one model. Who dafuq can afford to build a modest super computer that has like 22 000 cpu 120 000 gb ram units?Normal consumers can train their own model sure but it will be shit. Just random hallucanations, random answers everything random
>>524462808fins are worse than kikes, liberally nation of feminized faggots, afraid of everything
>>524465620there are legit applications for a local llms such as content categorization and context-dependent actions (such as firing your wifi gun turret)but aifags are slop addicts and rarely shill them for anything useful
>>524462601>what for?Creating CyberHitler, obviously.
lmao at the luddites not realizing all this training bs right now going straight to us chads who run everything offline its clearly a dumbass tech bubble and we have zero stakes because the final product has zero competitive moat
>>524465495Weird how things never change.
>>524462909>it's never profitable to self host inference let alone train a serious model with +100 billion parametersYou can actually self host a 106 billion parameter model. You need 64 GB RAM, a decent CPU, and at least 8 GB VRAM GPU which is pretty mid tier. The RAM is crazy expensive now, of course, but it used to be a mid tier gamer PC 6 months ago.The idea is that the attention parts are running on the GPU VRAM, which have a lot of computational requirements but don't take so much memory.The FFN runs on the CPU, which only run once per iteration, but take a shitload of memory.You can have a slightly higher token generation speed than an average person's reading speed, so it's enjoyable for fiction.The Q3_K_S quant fits nicely into 64 GB RAM and 8 GB VRAM.https://huggingface.co/unsloth/GLM-4.5-Air-GGUFThe whole reason why RAM is so expensive now is because it's feasible to run huge models partially on CPU and regular RAM, the modern Mixture of Expert models don't necessarily need to fit into VRAM to have decent inference speed.
>>524465988you don't need LLM for that, a simple ML will work just find to identify target and fire a gun. fore most applications simple neural network is sufficient. fin and others are being neurotic bitches larping as ai experts to look cool in front of their faggot friends
>>524462482the jews are progressively pricing out the goyim out of personal hardware precisely to avoid thatAI will get better and better, who controls it will control the world and they want a monopoly on that
>>524462482nice gpus
>>524466100I guarantee Patrik that there will be serious national security talks within five years about companies and national agencies using openai or external services to build their IT infra.
>>524466359kek in 4 years youll have to chose to be owned by america or russia
>>524466359The next step in enterprise LLM is to use ZK proofs for prompt validation. I recommend you to check that out.
>>524465246>Which is why every year thousands of German women go to Puerto Escondido, Oaxaca for sex tourism.brown people really do believe dumb shit like this
>>524466478I will tag your read for tomorrow. Thanks for the input.
>>524465683>German doesn't have the infrastructure to support the electricity required for computeor I just pay 20 bucks to the openAI jew and get access to the mutt data centers.less pollution, no ugly data centers shitting up the view etc.its great.basically why do something myself when I can get a dumb brown amerimutt to do it for cheap?you mexicans should understand this process very well kek.
>>524466478>ZK proofs for prompt validationlol, most retarded shit I've heard today. ooh yea, AI going to interact with my "sensetive" data without actually exposing that data to the server but server has logs of every input and output. that's like kikes that claim to see curvature of earth standing at the beach
>>524466667I don't believe dumb shit like that, I've experienced first hand, dumbfuck.My best friend is currently living in Stuttgart where he has a kid with a German woman.In Mexico City, you just need to go to Condesa or Roma and you will see countless of European women with Mexican mestizo children.Retarded faggot.
>>524466359I've mischaracterized my argument, no serious companies are using anything without a watertight data usage agreement right nowThe point i'm trying to make is that the stuff that has been released open source and can be run offline remains 90% as good as the best models, meaning there is really still little actual competition vs just "do it yourself offline"
>>524466855>My best friend is currently living in Stuttgart where he has a kid with a German woman.why didnt he stay in mexico and have a kid with a mexican woman?is it because your brown mexican genes are ugly and disgusting? mexican woman are ugly, mexican children are dumb as fuck and they live essentially in what is a garbage pile.why move to germany if Mexico is such a paradise?kek and shes probably a 3/10 anyway so who gives a fuck.
>>524466128>it's feasible to run huge models partially on CPU and regular RAMIt's feasible but it's not practical for production/enterprise use. CPU/RAM are simply not optimized for LLMs which are SIMD-based. RAM bus is way too narrow and CPU circuits are not designed for heavily parallel computations like GPUs and TPUs.
>>524466794From how you call everyone brown, you are 100% a quadriplegic half retard on government gibs. I thought you were engaging in good faith arguments but a kraut is just a robot. beep boop, I was only following orders, beep boop give the mega congomerates your data, beep boop. Go fuck yourself retard kike, you fucking inbred mongoloid. My shit are more important that you.
>>524466975kraut that hasn't gotten pussy in his 40 years of living in germany seething hard that german women rather go make babies for spik goblins than deal with neutered german "man"
i own a dgx sparkwhat do
>>524462601I like Grok myself.
>>524467087He calls everyone brown to feel good since he can't get pussy. Brown people fuck the hot bitches while he calls everyone brown because the only way he can find glory is to go so far back to a time they lost. Twice.
>>524462482>prosumergayest word of the year award
local AI is fun
>>524466975Because she, like thousands of German women, came to Mexico to get pregnant, so she fucked my friend under the guise of being infertile due to endometriosis and ended up pregnant with his child.Yet my friend didn't want the kid to be fatherless so he stepped up and went there to raise the kid.Notice how the rest of your post is a bunch of cope which wasn't ever mentioned.Fucking hilarious cucked German. Ease your seething by ordering some halal food, stupid fuck.
>>524466949I believe you are talking legalese and I'm talking tech, yes/no?
>>524462482get two of these things. For less than $8000 you get 256GB VRAM.
>>524467159he should take a look around, everyone in germany is brown
>>524462898>i have more of a right to your money than you doyou are spiritually jewish anoncorrect that
>>524467295yep
these models are all garbage. ask it about crime stats. it'll lie about blacks firstly, then if you force it to mention real stats it'll excuse rapes and murders for 'socioeconomic' reasons
>>524467481And no fucking way you played ao a few years back? That'd be too much of a coincidence.
>>524467075>From how you call everyone brownbut you are brown and so is the guy from mexico.so how am I wrong?do you see your brown skin as an insult? guess it is if it offends you so much it is an insult and rightfully so, you should be ashamed of the color of your skin. if its brown flush it down etc.>give the mega congomerates your datawhat data?how retarded are you that you type in sensitive data into some jew server?>remember hes brown skinnedoh nvm>>524467087>german women rather go make babies for spik goblinsthe retarded poorfag underclass has to come from somewhere. once again shitskins doing the jobs we whites dont want to do kek
>>524467347>get this>no name, no title, nothingretardNVIDIA DGX Spark Founders Edition (940-54242-0006-000) AI Server 4TB NVMe 128GB DDR5X | Personal AI Computer for Deep Learning, LLM & GPU Computing
>>524467651>once again shitskins doing the jobs we whites dont want to do kekI don't think it's a flex you think you're flexing, retard.
>>524467286>"1000 woman from a country with 80+ million people went to mexico to make a goblin retard! its the end of germany!"brown people are really retarded lmao. no wonder you idiots need AI to function.>Yet my friend didn't want the kid to be fatherless so he stepped upmore like he didnt want to go back to the brown people filled shithole that is Mexico so he decided to become a welfare collecting retard here in Germany.thats very typical for brown people. they always leave their shithole behind to leech off others. doubt that brown moron gave a shit about his goblin kid (which will be a trash collecting loser here anyway).
>>524467630nah im a different dude, going to be straight with you king
>>524467564That's why so many of us are advocating for local LLMs.You just make it fetch local crime statistics and you get the data without filtering or censorship from OpenAI or others.The issue now relies on the data, we all know that white crimes are inflated by claiming Middle Easteners and Hispanics are Whites, so if somehow you could manage to find a database that also includes mugshots, you could pair your LLM with a local visual model to filter them to accurately measure European whites.That's why there's so much kvetching against AI. The useful idiots don't understand that they are giving entities like the EU (who don't even provide data of their criminals anyways) the power to demand regulation so they can create their own panopticon where the only AI available is the one they control.But the pandora's box has already been opened and anyone can have the tech in their homes, so their next solution is to make the hardware extremely expensive for the local user.
>>524467841lol! look at this kraut cuck seething and coping
>>524467841No, the end of Germany is the hordes of Africans and Muslims raping your country while you feel like hot shit for uncontrollably seething here, because you would be arrested if you did it IRL lollmao
>>524467929>"I need an AI to explain to my retarded ass that niggers and shitskins arent fit for civilization"lmao next you tell us you trained the AI to tell you that water is wet.
>>524462482I don’t care. I only goon to image-2-video and your shitty 10k setup isn’t even close to rendering anything decent at any tolerable speed.
>>524468009literally nothing is happening tho
>>524462601>using OpenAI and not GrokPicrel
>>524462482>consumerismfuck off
>>524467929´This is why the right move is just sitting and waitingMeta and deepseek and others are just releasing all their good AI shit open source constantly, the genie CANNOT be put back in the bottle
>>5244624824 a16s... lol
>>524467651You are making no sense nigger, this place must stop bringing in the dredges of society. Motherfucker you were jumping from branch to branch like monkeys when we were building parthenons. Do you recognize my flag nigger? Maybe because you are low IQ you don't realize. Also being white is considered sickly here. Anemic motherfucker. Second of all, you are a corpo shill. A bootlicking retard whose ancestors got so fucked you now have most your population Turkish. Third of all, maybe you kiss corporate ass and want the inbred Elon Musk to give your ass babies, but you are just a retard on a 4chan board. A miserable one at that. I'm going to fuck a german bitch next summer. They come here and suck tourist dick every year.
>>524468087There's literally a post from a burger in this thread saying that Krauts would be the first ones justifying their own rape as a non-issueFucking hilarious.Keep seething about brown people online while the 10234th mosque is built in your country, faggot
>>524468208I bet the retard thought your flag was from Uruguay.It's hilarious how the effeminate cucks can't think clearly once they start seething.
>>524468068I am not saying it is the fastest and best. Never did. The best I said was 'prosumer', which referred to my infra, not the gpu.
>>524468208>literally "we wuzzing"lmao>Also being white is considered sickly here. shitskin cope>Second of all, you are a corpo shill.I'm not>you now have most your population Turkishthats not true>and want the inbred Elon Musk OpenAI is ran by that jew Altman, Musk has Grok.>I'm going to fuck a german bitch next summer.keep dreaming brown guy
>>524468235>There's literally a post from a burgerwho cares?>Keep seething about brown people onlinehating brown people is based
>>524468490>hating brown people is basedNot based enough to do anything about it except claiming that Germany isn't being raped by hordes of Muslims and Africans though.Too funny.
>>524468200In-house. You maybe had an argument, but I missed it.
>>524468594even in its current shithole form Germany is still a million times better than Mexico, otherwise Mexican shitskins wouldnt come here.
>>524462482nigger, i cant afford food. the monthly power bill alone would ruin me.
>>524468594Fuck you you goblin piece of shit. How dare you talk about Germany you fat spic freak.
>>524469126>fixates with Mexicans when the brown hordes raping his country, demanding complete change of his culture and customs, depleting their economic resources and pushing for globohomo are Muslims and Africanslmao it's hilarious how you're unwittingly showcasing how you see yourself as a second class citizen in your own country.Not arguing with a seething retarded cuck anymore, waste of time which I could be using programming more LLMs.Here's a picture of my great grandpa as a gift :)
>>524464593just so you know these conversations are stored forever and will can be used against you in court
>>524469289>his grandpa was a dalmation poodle mutt mixx
>>524468594The other euro cope is "well america is flooded with spics!" . Except we are beginning to deport them, and they will deport nobody. And guatemalan indios are nowhere near as bad as syrian muslims. The illegals need to all go home but im glad were not flooded by muslims. A guy did a march in texas recently where he had the quran in the mouth of a pigs head and was preaching against islam. Also burnt the quran. Put bacon in the quran. That german cant do that in germany. Hed go to jail. Theyre already under shariah law . The muslims will bide their time and then they will strike hard when their numbers are greater and they sense an advantage. Consistent terrorist attacks in the meantime. Meanwhile this german brags about how colored foreigners are breeding with "low class" White german women. Some serious copium
I'm not of this world merely in it for a season
>>524469289>fixates with Mexicansbecause you are mexican and you even told me you know about a mexican shitskin that moved here.but you see, to me the Mexican shitskin is the same as the Muslim shitskin or the African shitskin.they are all shitskins, thats what they all have in common.>Here's a picture of my great grandpaand nothing is left of his genetics but a brown goblin who brags about having some white ancestry in the distant past.kek
>>524469452>A guy did a march in texas recently where he had the quran in the mouth of a pigs headamerimutts literally kneel down for niggers and build big statues for niggers.if you say negative things about niggers in the USA you will get fired from your job.freedom of speech is not freedom of consequences and thats why most mutts are cucks for niggers and jews.
>>524469452>my BBCs are more based than your BBCs!!sportsball brained take
>>524469452German men are incredibly passive aggressive and they are weak lanklet retards, I know because they also go to Oaxaca for sex tourism but they are afraid of flirting with goblinas kekAnyways, imagine being seething uncontrollably in a thread and the only person that comes for your support is a shiteater. Embarrassing.
>>524469638>yeah. I live under sharia law and its illegal for me to desecrate the quran. But what about niggers? Cope >>524469644I didnt mention niggers in my post but thats where your mind went. Typical jeet. There are jeets who are darker skinned than any indio or mestizo.
>>524466975>they live essentially in what is a garbage pile.Germanon thinks he knows all about Mexico because he's been to Tijuana and Juarez.
>>524469886>and they are weak lanklet retards, so you are brown AND a manlet. didnt expect that (actually I did, brown people are always short).>>524469938>yeah. I live under sharia law and its illegal for me to desecrate the quran.not true at all.>But what about niggers?what about niggers? why do you love them so much?
>>524469638Always remember the demographics of the USA. You're debating two spics. And remember what spics are. Only 7 families migrated from Indonesia to the Americas and populated the entire two continents. They're a bunch of savage inbred retards. Until the Sephardic jews were kicked out of Spain and bred with them. Then they became a mix of two savage inbred schizos in one. There will never be any good man of potential born as a spic.
