/lmg/ - a general dedicated to the discussion and development of local language models.Previous threads: >>107803847 & >>107790430►News>(01/08) Jamba2 3B and Mini (52B-A12B) released: https://ai21.com/blog/introducing-jamba2>(01/05) Nemotron Speech ASR released: https://hf.co/blog/nvidia/nemotron-speech-asr-scaling-voice-agents>(01/04) merged sampling : add support for backend sampling (#17004): https://github.com/ggml-org/llama.cpp/pull/17004>(12/31) HyperCLOVA X SEED 8B Omni released: https://hf.co/naver-hyperclovax/HyperCLOVAX-SEED-Omni-8B>(12/31) IQuest-Coder-V1 released with loop architecture: https://hf.co/collections/IQuestLab/iquest-coder►News Archive: https://rentry.org/lmg-news-archive►Glossary: https://rentry.org/lmg-glossary►Links: https://rentry.org/LocalModelsLinks►Official /lmg/ card: https://files.catbox.moe/cbclyf.pngComment too long. Click here to view the full text.
>>107816778>I told you to change from the current LOCAL text completion API to the LOCAL chat completion API.ah alrightwhen I opened chat completion source I've seen all cloud providers and assumed it's a cloud only option
>>107816757After you're done fucking around with Mistral, the only way higher is one of the giant MoEs after obtaining more memory, and using a UD version of one.
>>107816837Got it.Here's an example of connecting to llama.cpp.kcpp should be similar if not the same.
ok whoever told me to leave instruct template enabled was full of shitbecause it was instruct template that caused it to write out of character
>>107816884UD?
This is a thread for all AI CLI related discussionClaude Code: https://code.claude.com/docs/en/overviewGemini CLI: https://geminicli.com/OpenAI Codex: https://openai.com/codex/OpenCode: https://opencode.ai/New:>Skills are now available in Gemini CLI in the preview branch: https://geminicli.com/docs/cli/skills/>npm install -g @google/gemini-cli@previewThe CLI's are not just for code. They can just do things on your computer.
>>107806541Why a TUI? I've got nothing against terminal emulators but what's the benefit for these AI interfaces compared to a GUI chat?
>>107816586No copy+paste errors and no browser fuckery.
>>107816635But how does it compare to a native GUI like an editor chat sidebar? I've been trying Copilot with a free Pro subscription and a TUI seems like it'd be less convenient.I'll probably try OpenCode regardless since the less Microsoft fuckery the better but I can't tell if I'm missing something.
>>107816214>anthro's already trying to shutdown opencode integration's.only via claude subscriptions. they're not cutting api access
>>107816125API keys are token-billed and there's no indication they are going to whitelist them (using them in random shit is the entire purpose of API keys)The whitelisting already exists on claude's internal tokens which uses their special subscription billing, bypassing the typical API prices. It's what opencode is playing cat and mouse to use, because it's much cheaper than token billing, but is obviously brittle since they try to block you
>AI bubble bursts>market flooded with cheap partsWhat are the chances of this happening?
>>107816752I just find it hard to believe a company would sell things for scrap when they still have value that is greater than the scarpthere are whole companies that exist to profit from that fact. the company that ungraded their data center can just sell all the old computers they replaced to this intermediate company that does the heavy lifting.there are people in the US who basically make their whole living off buying pallets of old computers from companies every few years and then parting them out and selling their for components on ebay
>>107816272at this point you can only bring down prices by law and even then you must be able to enfoce them
>>107816292but what if i want that though?>mfw cant run your ai waifu in your local (bedroom) datacenter
>>107816344same NAND-chip, different connector/chassi/whateverit's not that they're buying consumer ram, they're buying so much server ram that the manufacturer can't/wont produce condumer ram instead (because of NAND chip shortage.
>>107816800>I just find it hard to believe a company would sell things for scrap when they still have value that is greater than the scarpTaxes anon. Taxes and fees.. Scandi-taxes are brutal. And nothing is more brutal than company fees. For a company to sell tech they need to first get all the stuff appraised. Then it need to be confirmed safe and legal (no data left, even stuff without storage), then it needs to be brought to auction or sold via "recycled tech" companies who also do their own check to determine the state, quality and condition of all of it. And they then take a cut of the profit. Meanwhile the state wants their share since 99.9% of companies here are state-funded or at least have gotten enough backing for them to have an interest. And a billion other things. By the time you sell your shit, you can actually lose money on it. The solution? Scrap it. Get the environmental tax cut for recycling.
Gud morning microsaars please do the needful and buy laptops plz saar
Just step 1 in the master plan>Eliminate/outsource all decent paying jobs to turdworld>1st world high value consoomers cant consoom>Welp, time for the option both the poors in the 1st world and turldworld can consoom: Hardware as Subscription!
>>107815034I am very pro-AI. AI is the future. These so-called "AI PCs" are a scam, though. The NPUs they use are no better suited to any task than existing hardware. It is a shame because a well-designed NPU could help mitigate data center power usage at the edge but Microsoft more or less poisoned the water on AI PCs with this flop. Perhaps it was intentional, to help keep hardware costs down.
>>107815034Let's see: can those "AI PC's" run ComfyUI and generate porn?No?Then what's even the point vs. just using an online AI?
>>107815412Baited the entire thread award
>>107815904yes, shit economy and authoritarianism go hand in hand
Best Practices Editionprevious: >>107761293READ THE (temp)WIKI! & help by contributing:https://igwiki.lyci.de/wiki/Home_server/hsg/ is about learning and expanding your horizons. Know all about NAS? Learn virtualization. Spun up some VMs? Learn about networking by standing up a OPNsense/PFsense box and configuring some VLANs. There's always more to learn and chances to grow. Think you’re god-tier already? Setup OpenStack and report back.>What software should I run?Install Gentoo. Or whatever flavor of *nix is best for the job or most comfy for you. Jellyfin/Emby/Plex to replace Netflix, Nextcloud to replace Googlel, Ampache/Navidrome to replace Spotify, the list goes on. Look at the awesome self-hosted list and ask.>Why should I have a home server?De-botnet your life. Learn something new. Serving applications to yourself, your family, and your frens feels good. Put your tech skills to good use for yourself and those close to you. Store their data with proper availability redundancy and backups and serve it back to them with a /comfy/ easy to use interface.Comment too long. Click here to view the full text.
>>107816039Ok anon what exact post count would you like the new thread made at? :)
>>107815771Why is she missing a sock
>>107816221Oh wow, I just checked the prices in my country. $700 for the 24TB Red Pro.Time to go back to shucking drives, I guess.
>>107816476To make sure she didn't build up too much statis electricity.
I fucked up and held off buying HDDs.Should I get this now? I need more space.It's $469 * 13% tax + $108 shipping = $638. Or $24.5/TB.In comparison, new HDDs are usually $33/TB now.
>UIs to generate animeComfyUI:https://github.com/comfyanonymous/ComfyUISwarmUI:https://github.com/mcmonkeyprojects/SwarmUIre/Forge/Classic:https://rentry.org/ldg-lazy-getting-started-guide#reforgeclassicSD.Next:https://github.com/vladmandic/sdnextWan2GP:https://github.com/deepbeepmeep/Wan2GPInvokeAI:https://www.invoke.com/>How to Generating Anime Imageshttps://rentry.org/comfyui_guide_1girlhttps://tagexplorer.github.iohttps://making-images-great-again-library.vercel.app/https://neta-lumina-style.tz03.xyz/>Output cleanupComment too long. Click here to view the full text.
Geez, even with following Grok's advice getting logos right is tough. I tried several different things and failed to get the KDE logo right.
>>107815769can I see her gnome logo if you know what I mean?
>>107816771Not from me. Here is the logo for anyone that wants to try.
What do I need in order to make my own Neuro?
There so many of these fake AI nigger vtumors and they are all exactly the same ass shit but dont get gaslit spammed relentlessly across social media by major production company so you never hear of them>ITS POPULAR THAT MEANS ITS GOODyou have to be 18 to post here, fuck off.
>>107816409>How so? You must be lyingYou still need to know how to train the AI with the right data. You still need to have all of the glue code needed to stitch likely multiple AIs and long term memory and have a way form them to interact with other software.Making temu neurosama is easy but making an actual more equivalent is a time creep and still requires you to know how to code even if you use chatGPT for assistance.If you break it down it much more evolved then you think.> the sourgrapes coping retards told me that what Vedal did was nothing impressive and that you just need to slap a LLM with some with some TTS and that's it.Yes and no. It depends on what you respect, do you respect someone creating a really good GUI for FFMPEG for example?At the end of the day you should challenge someone to do the same thing if they think it's effortless.
>>107816541Neuro is as real as your stupidity
>>107816409I am actually curious if people have thoughts on this. I haven't watched much of neuro so I'm not sure what is so attractive about her or what is impressive about what she can do. I did some searx'ing and saw some redditors making vague comments about how you can't just connect an llm to a vtuber model, how much skill vedal has, how hard he has worked etc. That all might be true, I don't know---but I'm wondering what specifically about neuro suggests that she required more sophisticated engineering than just some RAG setup and prompt engineering? >>107816544Clearly there is some engineering work involved to integrate all the moving pieces. But like, is that it? Something that someone could crank out in a week with Opus 4.5? You mention training, is he actually training anything himself? My gut says there's some kind of secret sauce beyond just stitching a bunch of things together---no doubt that takes some engineering work to do well---but is that all that you really need to do to become the top 5 twitch streamer or whatever?
>>107816781>is he actually training anything himself?I don't know for sure, But a model purposely trained to have these characteristics is far better than a system prompt, in my testing system prompts aren't good enough for that.And then have that AI run a stream for multiple hours, how does it not forget what character to play as? At some point it runs into a token limit and then forgets shit.
>>107601582"The further a society drifts from the truth, the more it will hate those that speak it."--George Orwell>CyberpunkThe FAQ: https://sizeof.cat/post/cyberpunk-faq/What is /cyb/erpunk?: https://pastebin.com/pmn9vzWZHow do I into /cyb/erpunk?: https://pastebin.com/5tpNFQdsHuge list of cyberpunk media: https://sizeof.cat/post/cyberpunk/The cyberdeck: https://pastebin.com/7fE4BVBgCyberlife: https://jinteki.industries/files/cyberlife.7zBibliothek: https://www.mediafire.com/folder/4m5hd2065hde8/Bibliothek>PrivacyTools: https://www.privacyguides.org/en/tools/Comment too long. Click here to view the full text.
>>107811319Any good IRC channel for /cyb/ frens?
>>107813748 >>107815066I have none of those but we have some documents over in Sizeofcat and a lot of comfy files over inhttps://valis.moe/
wtf is wrong with 'https://igwiki.lyci.de/wiki/' ?
>>107760146Why even keep the internet up if it's completely overrun and unusable? Why is every "closed network" still hooked up to the dangerous place?
>>107816668Other than a massive roaring edit war, I'm not sure what you had in mind. The old wiki at InstallGentoo was brought down by vandalism and now just redirects to this new wiki.
ITT we share non-russian, non-porn, non-crypto channels/groups.I start>https://t.me/music_and_links
>>107815105your argument is irrelevant
I want russian porn channels though
>>107814910https://t.me/+JV86mlQgE51mOTkx
>>107815663https://t.me/joinchat/B1LyWxBwYouLwm2zKQweLQ
>>107816833requested to join
We lost the ability to make controllers that don't break after 2 years due to joystick drift.
>>107810847you can still buy pic related, what about it is "lost"?
>>107811191What is thisWhy am i hardStop it
gulikit has hall effect joysticks and easily replaceable face buttons but I just end up invariably wearing out the shoulder buttons instead and then buying another like some sort of stockholm syndrome victimI need to see if generic replacements (that require soldering) meant for official xbox or switch controllers would work
>>107812823>>107813108Dreamcast and Saturn had hall effect switches.Fucking based
>>107813319Sega hardware was too based for this world.
Why cant i connect a Bluetooth earphone to this thing. Is there a way to hack it to make it able to
why did you buy an xbox?go google it or ask AI
>>107816889I just had it since 2020 and never bothered to sell it because noone wants it
>giant spinning doughnut... in C!!!
>bad apple on a FM Towns Marty
In 8 years, OpenAI will use 50% of the US's total electricity generate.This isn't factoring the amount of GPUs they'd be purchasing, nor the fresh clean water they'd need to cool the GPUs powering their data centers.USA's electricity generation has stagnated for the past 30 years despite a rise in population.How much do you imagine your electricity bill to be by 2033?
>>107814760>m****?????
>>107808913Energy companies will leave the consumer market to sell power to big tech.
>>107814467>Most of those cards will be fried.I used several cards for years and years after doing a ton of mining on them. The whole "gpus will be fried after being used for mining/ai/whatever" crap is horse shit.
>>107814745i kinda want to do that unfortunaly there's barely sun where i live and eolian is horseshit when it comes to production but might go for it because it's windy.
>>107808913Sounds expensive. So uh, how are they gonna make a profit?
How do you respond without sounding mad?
By banning the clanker without saying a word and moving on.
>AI decided to do so and I didn't question it
>>107815945Why can't they work on something like FreeCad and improve the interface instead? Why waste time on writing a debugger interface for a programming language?
>>107816033>Every line of code you write is a liability.So many people fail to understand this.Code is not an asset. It's a liability. It's something you're stuck with and have to maintain until decommissioned because it's no longer viable to continue building a business on.The asset is the deep technical and business-domain knowledge that allowed you to produce that code.
>>107816868nice propaganda, freetardbro
Previous Thread: >>107755027>Links:>DALL-E 3https://www.bing.com/images/createhttps://designer.microsoft.com/image-creator>4ohttps://chatgpt.com/https://sora.chatgpt.comhttps://copilot.microsoft.com/>Imagen 4 and Nano Banana (Pro)https://gemini.google.com/apphttps://labs.google/fx/tools/image-fxhttps://labs.google/fx/tools/whiskhttps://aistudio.google.com/prompts/new_imageComment too long. Click here to view the full text.
>>107782631I find adding "slimthick" in usually generates women that are right at that line of being soft but not fat. Whereas "curvaceous" sometimes works but usually generates big fat chicks.
>lost my source of free NBP
