/g/ - /lmg/ - Local Models General - Technology

Anonymous

/lmg/ - Local Models General 11/09/24(Sat)17:28:36 No.103135187

File: Untitled.png (54 KB, 200x200)

/lmg/ - Local Models General Anonymous 11/09/24(Sat)17:28:36 No.103135187 Archived

/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>103126193 & >>103113157

►News
>(11/08) Sarashina2-8x70B, a Japan-trained LLM model: https://hf.co/sbintuitions/sarashina2-8x70b
>(11/05) Hunyuan-Large released with 389B and 52B active: https://hf.co/tencent/Tencent-Hunyuan-Large
>(10/31) QTIP: Quantization with Trellises and Incoherence Processing: https://github.com/Cornell-RelaxML/qtip
>(10/31) Fish Agent V0.1 3B: Voice-to-Voice and TTS model: https://hf.co/fishaudio/fish-agent-v0.1-3b
>(10/31) Transluce open-sources AI investigation toolkit: https://github.com/TransluceAI/observatory

►News Archive: https://rentry.org/lmg-news-archive
►Glossary: https://rentry.org/lmg-glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png
►Jarted: https://rentry.org/Jarted

►Getting Started
https://rentry.org/lmg-lazy-getting-started-guide
https://rentry.org/lmg-build-guides
https://rentry.org/IsolatedLinuxWebService

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
Chatbot Arena: https://chat.lmsys.org/?leaderboard
Censorship: https://hf.co/spaces/DontPlanToEnd/UGI-Leaderboard
Censorbench: https://codeberg.org/jts2323/censorbench
Japanese: https://hf.co/datasets/lmg-anon/vntl-leaderboard
Programming: https://livecodebench.github.io/leaderboard.html

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler visualizer: https://artefact2.github.io/llm-sampling

►Text Gen. UI, Inference Engines
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/lmg-anon/mikupad
https://github.com/turboderp/exui
https://github.com/ggerganov/llama.cpp

>>

Anonymous
11/09/24(Sat)18:54:28 No.103136009

Anonymous 11/09/24(Sat)18:54:28 No.103136009

File: 1730779367531716.png (1.72 MB, 1024x1024)

1.72 MB PNG

> heheh

>>

Anonymous
11/09/24(Sat)19:58:32 No.103136492

Anonymous 11/09/24(Sat)19:58:32 No.103136492

File: checkmatealtman.png (317 KB, 748x955)

317 KB PNG

how true are the rumors that the models are hitting a wall? anthropic at least definitely seems to be stalling out; will openai start walking back the hype?

>>

Anonymous
11/09/24(Sat)20:13:23 No.103136614

Anonymous 11/09/24(Sat)20:13:23 No.103136614

>>103136492
https://youtu.be/35IpOK-WaNA?si=a8D1aC-WK1Ldtu8e