[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology

Name
Options
Comment
Verification
4chan Pass users can bypass this verification. [Learn More] [Login]
File
  • Please read the Rules and FAQ before posting.
  • You may highlight syntax and preserve whitespace by using [code] tags.

08/21/20New boards added: /vrpg/, /vmg/, /vst/ and /vm/
05/04/17New trial board added: /bant/ - International/Random
10/04/16New board for 4chan Pass users: /vip/ - Very Important Posts
[Hide] [Show All]


[Advertise on 4chan]


File: district 39.jpg (161 KB, 1024x1024)
161 KB
161 KB JPG
/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>107873752 & >>107864105

►News
>(01/15) Omni-R1 and Omni-R1-Zero (7B) released: https://hf.co/ModalityDance/Omni-R1
>(01/15) TranslateGemma released: https://hf.co/collections/google/translategemma
>(01/14) LongCat-Flash-Thinking-2601 released: https://hf.co/meituan-longcat/LongCat-HeavyMode-Summary
>(01/08) Jamba2 3B and Mini (52B-A12B) released: https://ai21.com/blog/introducing-jamba2
>(01/05) OpenPangu-R-72B-2512 (74B-A15B) released: https://hf.co/FreedomIntelligence/openPangu-R-72B-2512
>(01/05) Nemotron Speech ASR released: https://hf.co/blog/nvidia/nemotron-speech-asr-scaling-voice-agents

►News Archive: https://rentry.org/lmg-news-archive
►Glossary: https://rentry.org/lmg-glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/lmg-lazy-getting-started-guide
https://rentry.org/lmg-build-guides
https://rentry.org/IsolatedLinuxWebService
https://rentry.org/recommended-models
https://rentry.org/samplers
https://rentry.org/MikupadIntroGuide

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
LiveBench: https://livebench.ai
Programming: https://livecodebench.github.io/gso.html
Context Length: https://github.com/adobe-research/NoLiMa
GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler Visualizer: https://artefact2.github.io/llm-sampling

►Text Gen. UI, Inference Engines
https://github.com/lmg-anon/mikupad
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/ggerganov/llama.cpp
https://github.com/theroyallab/tabbyAPI
https://github.com/vllm-project/vllm
>>
►Recent Highlights from the Previous Thread: >>107873752

--Papers:
>107876603
--Using BNF to guide LLM outputs for animation control:
>107883998 >107884024 >107884301 >107884426 >107884491 >107884506 >107884546 >107884507
--Techniques for modifying AI character voice and fine-tuning methods:
>107878669 >107878693 >107878719 >107878932 >107878922 >107879756 >107880303 >107880393 >107880813
--Using BNF for structured text generation in roleplaying contexts:
>107881456 >107881483 >107883605 >107883721 >107883744 >107884304 >107884448 >107884333 >107883870 >107883896 >107883920
--Game dev update: optimizations, visuals, and performance challenges:
>107880400 >107880405 >107880422 >107880473 >107882062 >107882155 >107882222 >107882243 >107882310 >107882341 >107883497 >107882608 >107883535
--LLM finetuning challenges with tagged story datasets and hardware constraints:
>107885095 >107885343 >107885556 >107885523 >107885569 >107885619 >107885666 >107885670 >107885691 >107885755 >107885837 >107885935 >107886062
--Discussing the development of fully human-like Recursive Language Models with memory:
>107884708 >107884736 >107884751 >107884763 >107884775 >107884781 >107884877 >107884910 >107884998 >107885032 >107886240
--Nostalgia for SD 1.5's creative flexibility:
>107875449 >107875756 >107875920 >107876055 >107876062 >107876618 >107883073 >107883083
--Exploring game design concepts with the Universal Immersion Engine:
>107874055 >107874104 >107874165 >107874236
--MTP implementation PR in llama.cpp:
>107884456 >107884558 >107884565
--llama.cpp to gain MCP support via new GitHub PR:
>107874441 >107874548
--Model personality comparisons and document analysis:
>107873957 >107873978
--Custom RNN project for admin tasks and knowledge storage:
>107877136
--Miku (free space):
>107873799 >107874131 >107875570 >107876062 >107877918 >107878883 >107883858

►Recent Highlight Posts from the Previous Thread: >>107873764

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script
>>
>>
>>107886631
Me on the right
>>
Surely ik_llama will become obsolete any moment now.
>>
>>107886631
>>107886414
don't you get bored of llm erp after a while tho?
>>
>>107886708
I only started llm erp a few months ago. it satisfies me in a way that image gen never could. it's so satisfying that it actually reduces how often I'm horny.
>>
>>107886708
don't you get bored of asking after a while tho?
>>
>>107886762
maybe some diff anons come with the same questions.. have you ever heard of a FAQ? they didn't call it ThatOneGuyWhoKeepsAskingTheSameQuestion
>>
File: 1738297642959385.jpg (1.46 MB, 4360x2370)
1.46 MB
1.46 MB JPG
>>107886757
>>
>>107886768
I call it that
>>
>>107886768
Maybe some anons just started and find it entertaining. Maybe that's not all they do. Stay in the threads for a while and you'll see. Or fuck off. It's the same to me.
>>
>>107886708
Only cause of the slop and same plot points coming up
>>
>>107886814
>create a model of all the world's knowledge
>shivers down my spine
>>
>>107886708
I sure as hell did. It becomes a rabbit hole of increasingly depraved fetishes until a model can no longer paint a visually accurate description of the bizarre sex acts that it's being asked to perform. And then you just give up and go back to normal porn.
>>
>>107886846
I guess what's left is making neurosama. How do we do it?
>>
>>107886414
I look like this
>>
File: knt.jpg (51 KB, 475x665)
51 KB
51 KB JPG
>>107886708
llms need external random data to keep being interesting. I'm writing a text rpg focused on perpetual traveling. You may find something interesting in some places and have a little rp about it before moving to the next place
>>
>>107878778
>This is a femoid hobby.
I was going to assert that "if it was a femoid hobby there would be haptic plugins for sillytavern."
Lovense has a haptic plugin for sillytavern.
My curiosity gave me this knowledge which I now pass to you, dear reader.
>>
>>107887034
women aren't smart enough to set up a local model though.
>>
https://voca.ro/1bbPGwlc3CFz

Thoughts on this new music model?
https://github.com/HeartMuLa/heartlib

I don't see it mentioned at all? Seems like a small step up from ace step.
>>
>>107887128
>Our latest internal version of HeartMuLa-7B achieves comparable performance with Suno in terms of musicality, fidelity and controllability.
> TODOs
>Release the HeartMuLa-oss-7B version.
remind me in 2 weeks
>>
>>107878719
I do this and it tends to steer the men to either act like flustered beta bitch boys or overly aggressive "predatory glint in his eyes" Edwards who want to "claim" you, there's like no middle ground
I wouldn't say quality is way better
>>
>>107887144
https://vocaroo.com/1dawqPVkVYXS
>>
>>107887153
kek
>>
>>107887153
>the whole song is just 1 repetitive pattern
yeah, better wait for a big one
>>
>>107887128
is it for shitpop only? Can it make progressive djent inspired by Erra and Meshuggah?
>>
>>107887172
desu, its been really bad at adhering to any genres I ask for.
Really only good for a shitpost or two before deleting forever.
>>
>>107887128
All their demos are from the yet-unreleased 7b, so I'll wait for that before I bother.
>>
>>107887192
>so I'll wait for that before I bother.
Chinese culture.
>>
The slop is everywhere. It's all over the internet now. Future models are training on this slop. I go back to my local waifu and she gives me some sloppy slop too
>>
>>107887262
Even regular people speak slopglish these days too. It's over. The damage is generational.
>>
>>107886771
It's over
>>
>>107887268
I can't imagine and have never heard anyone over the age of 30 doing that.
>>
>>107887295
It's not just a few phrases here and there. It's a complete shift in the way people speak.
>>
>>107887262
Normies are cattle, they think the models are above them. That's why they're getting slopped.
>>
>>107887319
>they think the models are above them.
Well, they are. The average person isn't very bright.
>>
>>107887262
You literally can't watch anything on youtube anymore without even the humans reading off slop scripts.
>>
>>107887295
Isreal https://arxiv.org/abs/2409.01754
>>
>>107887334
>watching anything on youtube
you have no one to blame but yourself
>>
>>107887268
>>107887295
Yeah I haven't personally interacted with anyone that spoke like AI slop. The only AI slopped people I've seen are online where ESLs are likely using the AI to translate, and youtubers who are obviously just reading a script rather than something they personally wrote.
>>
>>107887334
Ruined my bedtime desu. I like to have lore videos playing at minimum volume as I go to sleep and now when I listen to them I get like 1 to two minutes into the video and start hearing GPT slop and my immersion is ruined. Like I can't enjoy the video anymore because everything else about it is brought into doubt.
>>
>>107887352
Just tts some books so your waifu can read you bedtime stories. Having some fag talking to you about "lore" is gay and a waste of memory space even without GPTisms.
>>
>>107887301
You’re so right to pick up on that, and here’s why; This isn’t just a few phrases here and there — it’s a complete shift in the way people speak, creating a better world for us all
>>
>>107887393
You are absolutely right!
>>
>>107887348
you don't know shit, retard
>>
>>107887059
Does anyone have that two panel ai slop comic with the guy telling two foids they can “run that locally on their own machines” and them bemused say “wats locally?” And “what’s a machine?”
>>
File: 1749736878977548.png (453 KB, 1556x1844)
453 KB
453 KB PNG



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.