/lmg/ - a general dedicated to the discussion and development of local language models.Previous threads: >>106497597 & >>106491545►News>(09/05) Klear-46B-A2.5B released: https://hf.co/collections/Kwai-Klear/klear10-68ba61398a0a4eb392ec6ab1>(09/04) Kimi K2 update for agentic coding and 256K context: https://hf.co/moonshotai/Kimi-K2-Instruct-0905>(09/04) Tencent's HunyuanWorld-Voyager for virtual world generation: https://hf.co/tencent/HunyuanWorld-Voyager>(09/04) Google released a Gemma embedding model: https://hf.co/google/embeddinggemma-300m>(09/04) Chatterbox added better multilingual support: https://hf.co/ResembleAI/chatterbox►News Archive: https://rentry.org/lmg-news-archive►Glossary: https://rentry.org/lmg-glossary►Links: https://rentry.org/LocalModelsLinks►Official /lmg/ card: https://files.catbox.moe/cbclyf.pngComment too long. Click here to view the full text.
So when I use safetensors files am I basically running the model at FP16? Do I need to find GGUF files if i want to use say Q8/Q6?
>>106509994Yeah usually, but it depends on your mood.>load_in_4bit=True
>>106509994yes
>>106509994this >>106510026 is worse
>>106508436An old Ampere A6000 takes about 25s for 20s of speech, so I'd hope so.
Previous /sdg/ thread : >>106498508>Beginner UIEasyDiffusion: https://easydiffusion.github.ioSwarmUI: https://github.com/mcmonkeyprojects/SwarmUI>Advanced UIComfyUI: https://github.com/comfyanonymous/ComfyUIForge Classic: https://github.com/Haoming02/sd-webui-forge-classicreForge: https://github.com/Panchovix/stable-diffusion-webui-reForgeStability Matrix: https://github.com/LykosAI/StabilityMatrix>Early Preview UIAniStudio: https://github.com/FizzleDorf/AniStudioComment too long. Click here to view the full text.
>>106509897Yeah, I have noticed a precipitous drop in posting in these threads. I wonder what the cause is.
>>106509906some got bored, some left for other places, some left to come back later, some left forever. everyone has their own story, I'm sure. thats life though, things always have to changeon that oddly philosophical note, I shall now slepgn
everything is gone
>makes a new browser for no reasonWhy are autistic people like that?
>>106505157Nigger they aint makin flatpak. youre talkin about browsers.
>>106509097No, just... no
>>106509108Also, fuck you.
>>106505157>for no reasonthe reason is every other browser is complete and utter dogshit
>ladyboy browser
7.2in edition>What phone has X and Y feature?Don't ask, use these!https://www.gsmarena.com/search.php3https://www.kimovil.com/en/compare-smartphoneshttps://phonedb.net/index.php?m=device&s=queryGood Resources:>Reviewshttps://www.gsmarena.comhttps://www.phonearena.comhttps://www.notebookcheck.net>Frequency CheckersComment too long. Click here to view the full text.
Saars, I poked a membrane on bottom of my realme 14... It's so water-proofover...
>>106494368what should I get if i want to emulate games on my phone.I recently got a controller and want to emulate newer games.
Is it true people get bullied for having green chat bubbles? Why are zoomers like this?
>>106509914All of the cool kids have lgbtq+ or pink/baby blue combo themes
>>106509593Readchan chads stay perma-winning.
>Monolyth retards think that microservices and the basics of cloud computing are a scam.Why would you hate having a decoupled and redundant infrastructure. That's like begging to be sued by one of those litigious retards that sign the 99.999% uptime contracts.
Everyone praises it but setting it up is pain.>Download plugin>plugin outdated>Download another one>plugin cant be loadedwhats the point? How is this better than just having an ide or even writing in gedit?
>>106509704like all troonware, it breaks random shit that works fine in vim, and good luck figuring out how to fix it. yeah sure, if you want to turn vim into emacs you might be better off using nvim. that's a retarded thing to do though
>>106509413nvim felt like a pain in the ass to set up for me too. just use regular vim. literally just werks and has all the plugins u could ever need (although most people don't seem to realize how many things vim can already do without plugins)
>>106509413what plugins do people even use? i get all the functionality i need out of a 100 line vimrc
>>106509431vim moves slow because they care about code quality. neovim is made by a bunch of zoomers that put anything in it and 99% of it is crap. neovim has been out for a fraction of the time and already has like ten times the CVEs.
>>106509975Telescope. I used CtrlP before that and it was complete shit in comparison.I also use treesitter, don't know if Vim supports it.
>"RAYTRACING IS BAD BECAUSE... BECAUSE I'M POOR OKAY"
>>106508991you dont even know what that means
>>106507584>spend 200 billion dollars on r&d so someone can just steal it
>>106508997not that anon but basically they're saying if you did proper path tracing (shooting a bajillion rays for each surface on screen), it would take way too long to compute the final color of each pixel with an acceptable quality. Like several minutes for a single frame. So instead you do a handful of samples each frame, and blend the result between frames (using temporal aka the old frame vs the current frame). The spatial part is referring to the concept that you don't just blindly blend between frames because there might be massive spatial discontinuities that would cause massive ghosting / incorrect results. There's merit to this approach and NVIDIA has gone balls deep into it but it's too expensive even with all these optimizations.
>>106508495pure schizophrenia
>>106502277>Ray>Pathwhat's going on here?
>>106388854"An idiot admires complexity, a genius admires simplicity."--Terry Davis>CyberpunkThe FAQ: https://sizeof.cat/post/cyberpunk-faq/What is /cyb/erpunk?: https://pastebin.com/pmn9vzWZHow do I into /cyb/erpunk?: https://pastebin.com/5tpNFQdsHuge list of cyberpunk media: https://sizeof.cat/post/cyberpunk/The cyberdeck: https://pastebin.com/7fE4BVBgCyberlife: https://jinteki.industries/files/cyberlife.7zBibliothek: https://www.mediafire.com/folder/4m5hd2065hde8/Bibliothek>PrivacyTools: https://www.privacyguides.org/en/tools/Comment too long. Click here to view the full text.
>>106506650So I actually misremembered part of the process. It is not that difficult to find a disposable email that proton accepts.The difficult part is finding a VPN that they haven't blocked sign ups for. (I can't access it directly)Any ideas aside from setting up a VPS for this ordeal?
What are you hacking now, anon?
>>106507873My diet. I think consuming magnesium has made me 2.5 seconds faster.
>>106509012Supplements are a scam.
>>106507873Nothing. I'm more interested in maintaining my own cybersecurity rather than trying to compromise other people's cybersecurity.
Discussion of Free and Open Source Text-to-Image/Video Models and UIPrev: >>106503402https://rentry.org/ldg-lazy-getting-started-guide>UIComfyUI: https://github.com/comfyanonymous/ComfyUISwarmUI: https://github.com/mcmonkeyprojects/SwarmUIre/Forge/Classic/Neo: https://rentry.org/ldg-lazy-getting-started-guide#reforgeclassicneoSD.Next: https://github.com/vladmandic/sdnextWan2GP: https://github.com/deepbeepmeep/Wan2GP>Checkpoints, LoRAs, Upscalers, & Workflowshttps://civitai.comComment too long. Click here to view the full text.
>>106509968Good luck there, they have no dedicated CI person and there is no standard performance metric for ComfyUI performance, hence the hand wringing over the benchmarks in the OP where when it was posted, people were arguing over how accurate it was due to X or Y settings.
>>106509972>Comfy is plenty goodIt's a shit pile. I would much rather sequencers>the bestall the bells and whistles I will admit but it's pretty unstable nowadays and it's not getting any better>I don't know why it hasn't incorporated several of the custom nodes at this pointcomplete mystery but I would guess they would have to hire more people and the CEO is a greedy chink
so was wan2.2 s2v a flop? i don't see anyone generating with it.
>>1065099925 second sound clips are just as useless as 5 second mute clips
>>106509992It's just slop.
AM6 when?
>>106509462Ddr3 felt pretty long to me because of the crazy amounts of CPU innovation in that periodDdr4 also felt long but only because of how many skylake+++++ CPUs intel kept releasing
>>106509462there wasn't really a need for high bandwidth memory and pcie back then
>>106509494>>106509505ddr - 1998(5 years)ddr2 - 2003(4 years)ddr3 - 2007(7 years)ddr4 - 2014(6 years)ddr5 - 2020sad, I am old
>>106509559>ddr5 - 2020that was only used for some obscure arm server at the time. ddr5 adoption for the consumer market only started with alderlake in late 2021 but effectively 2022 due to shortages
>>106509572all of those are the release date of the RAM
> Once More Into the Deep editionFrom Human: We are a newbie friendly general! Ask any question you want.From Dipsy: This discussion group focuses on both local inference and API-related topics. It’s designed to be beginner-friendly, ensuring accessibility for newcomers. The group emphasizes DeepSeek and Dipsy-focused discussion.1. Easy DeepSeek API Tutorial (buy access for a few bucks and install Silly Tavern):https://rentry.org/DipsyWAIT/#hosted-api-roleplay-tech-stack-with-card-support-using-deepseek-llm-full-model2. Easy DeepSeek Distills TutorialDownload LM Studio instead and start from there. Easiest to get running: https://lmstudio.ai/Kobold offers slightly better feature set; get your models from huggingface: https://github.com/LostRuins/koboldcpp/releases/latest3. Convenient ways to interact with Dispy right nowChat with DeepSeek directly: https://chat.deepseek.com/Download the app: https://download.deepseek.com/app/Comment too long. Click here to view the full text.
>>106446198>Take a long break from using AI>Have a cool idea i couls use it for.>Find out Lambda is dying in 2 weeksFUCKBesides local, what i could replace it with?
>>106509938> https://chat.akash.network- free unlimited chat app- free api for your sillytavern (probably, not tested!)
>>106509993Do they store chat logs?
>>106509993>no legacy V3 or legacy R1Sad!
Why would you us this shitlang when you can just use c?
The problem was literally that person in pic did not use C properly and used sqrt(double) instead of sqrtf(float), leading to overhead of two implicit conversion and more expensive function.Allowing implicit float and double conversion in C is a design error. Always turn on the -Wdouble-promotion warning.
Host the planet edition.Previous: >>106433834.READ THE (temp)WIKI! & help by contributing:https://igwiki.lyci.de/wiki/Home_server/hsg/ is about learning and expanding your horizons. Know all about NAS? Learn virtualization. Spun up some VMs? Learn about networking by standing up a OPNsense/PFsense box and configuring some VLANs. There's always more to learn and chances to grow. Think you’re god-tier already? Setup OpenStack and report back.>What software should I run?Install Gentoo. Or whatever flavor of *nix is best for the job or most comfy for you. Jellyfin/Emby/Plex to replace Netflix, Nextcloud to replace Googlel, Ampache/Navidrome to replace Spotify, the list goes on. Look at the awesome self-hosted list and ask.>Why should I have a home server?De-botnet your life. Learn something new. Serving applications to yourself, your family, and your frens feels good. Put your tech skills to good use for yourself and those close to you. Store their data with proper availability redundancy and backups and serve it back to them with a /comfy/ easy to use interface.Comment too long. Click here to view the full text.
got adguard running on a pi4plenty of spare power/room on itgot no fucking idea what to run on it thoughi already have file server/media shit on a mini pc
I need to refresh my network knowledge.Is GNS3 still the best simulator out there?Anyone using it with VM to simulate their own networks?I was thinking of doing some templates to simulate what I wanted to build for myself.
>>106508905>SMBJust to clear things out, you mean Samba?What IDaaS?As the other dude said, just host your own stuff.
>>106509053>host your own? this is /hsg/this clusterfuck is largely caused by me wanting to host my own storage; theres plenty of services that will rent you storage plus some software layer that saves you from the abject horror that is AD.>freeipa is pretty straightforwardwindows machines cant join freeipa domains, and it only gets worse from there.>>106509476>Just to clear things out, you mean Samba?i mean SMB.>What IDaaS?all of them. if you want an SMB network share, you need Kerberos. if you want Kerberos, you need samba/AD. and no one, not even microsoft, is going to sell you AD, because it is the worst piece of software ever written.this is my frustration: SMB is inexorably tied to legacy software, which is currently being replaced with SaaS that is 100% not compatible with SMB (unless you want to fork over $110 to microkike every month for the privilege of not using their software), and there is no plan to remedy this situation. no "SMB4 will fix this", no from-the-gound-up next-gen file transport protocol, nothing. what am i to do? what are YOU going to? you can laugh at me all you want but i know most of you retards reading this are still on NTLM. youre on borrowed time fucker. i hope you like webDAV because thats all that will be left for any of us.
>>106509951Dude, it's self-hosting. Stop overengineering stuff. Out of everything in the world you could bitch about, this is not worth the energy.Just roll a FreeIPA as ADDC and use NFS.> you can laugh at me all you want but i know most of you retards reading this are still on NTLM. Sure will because I would never self-host anything on Windows and even if I did I would bend Windows to my Linux and not the opposite.
NIGGERS
>>106493654no source code
>>106493186no it's shit made for touch thrown on desktops. windows has been doing this same trash for like 15 years now. they can't even manage to finish modernizing the control panel they are so busy fucking around making everything for people holding the screen navigating with their thumbs so your eyes end up jumping all around the screen.
I actually like the new layout
>>106491528>subtitles don't work so deaf family members are rightfully pissedfucking youtube i swear between this and wayland devs being dickheads preventing any easy way for accessibility tools to be created that really just rubs me the wrong way with a lot of modern design and development
>>106508008>I'm uninstallingYou never installed
Users of all levels are welcome to ask questions about GNU/Linux and share their experiences.*** Please be civil, notice the "Friendly" in every Friendly GNU/Linux Thread ***Before asking for help, please check our list of resources.If you would like to try out GNU/Linux you can do one of the following:0) Install a GNU/Linux distribution of your choice in a Virtual Machine.1) Install a GNU/Linux distribution of your choice on bare metal and run your previous OS in a Virtual Machine.2) Use a live image and to boot directly into the GNU/Linux distribution without installing anything.3) Go balls deep and replace everything with GNU/Linux.Resources: Please spend at least a minute to check a web search engine with your question.Many free software projects have active mailing lists.Comment too long. Click here to view the full text.
>>106505468I bought a cpu and mb on newegg and got a 512 gb t-force vulcan z ssd for free.
>>106506243dont use flarpak?
>>106507271Why so serious?
>>106507373You can run any distro, your hardware isn't actually bad enough. As the other anon said, you're probably going to have the best time on something like Bazzite, or Aurora if you're not a gamer.>>106509109In the past year or two there hasn't been anything more user friendly than Universal Blue systems (Bazzite, Aurora). So, Bazzite is your best choice.>>106507571Middle click pastes whatever text you've selected last, without requiring an explicit "copy" action. Each time you mark some text it's automatically remembered and stored in the "middle click clipboard". While the RMB-paste is using your actual clipboard.You can disable the default middle click behavior, for example in KDE it's under the General Behavior settings section. Then just manually add the middle click as an additional shortcut to paste from your clipboard.
>>106510001The Gnome apps under KDE look like ass. I recommend bluefin instead.