/g/ - LLMs, ChatGPT - Technology


08/21/20	New boards added: /vrpg/, /vmg/, /vst/ and /vm/
05/04/17	New trial board added: /bant/ - International/Random
10/04/16	New board for 4chan Pass users: /vip/ - Very Important Posts
[Hide] [Show All]

Anonymous
LLMs, ChatGPT 03/19/26(Thu)19:14:43 No.108409972

File: 1752271170135420.jpg (73 KB, 1280x720)

73 KB JPG

LLMs, ChatGPT Anonymous 03/19/26(Thu)19:14:43 No.108409972

How much storage on an HDD or an SSD would ChatGPT, Grok, or Claude take up?

Anonymous
03/19/26(Thu)19:24:46 No.108410025

Anonymous 03/19/26(Thu)19:24:46 No.108410025

>>108409972
https://huggingface.co/xai-org/grok-2 500gb for grok 2, safe to assume later versions go up from there.

Anonymous
03/19/26(Thu)20:21:34 No.108410368

Anonymous 03/19/26(Thu)20:21:34 No.108410368

>>108410025
how did this get leaked. what is the catch to running it locally. is it just as censored as cloud grok?

Anonymous
03/19/26(Thu)20:25:22 No.108410394

Anonymous 03/19/26(Thu)20:25:22 No.108410394

>>108410368
>what is the catch to running it locally
My guess is the 8 GPUS with 40GBs of memory requirement

Anonymous
03/19/26(Thu)20:25:46 No.108410396

Anonymous 03/19/26(Thu)20:25:46 No.108410396

>>108410368
>leaked
xai "open sources" their old models whenever they release a new one.

Anonymous
03/19/26(Thu)20:31:21 No.108410440

Anonymous 03/19/26(Thu)20:31:21 No.108410440

>>108410396
that sounds kick ass. but given that you put quotation marks around "open source" i'm guessing there are some kind of strings attached? Can you imagine if OpenAI or Antropic did this.

Anonymous
03/19/26(Thu)20:36:28 No.108410468

Anonymous 03/19/26(Thu)20:36:28 No.108410468

>>108410394
>My guess is the 8 GPUS with 40GBs of memory requirement
yep

Anonymous
03/19/26(Thu)20:49:52 No.108410545

Anonymous 03/19/26(Thu)20:49:52 No.108410545

>>108410440
https://huggingface.co/xai-org/grok-2/blob/main/LICENSE
>>108410394
if you use a low bit quantization you can get it down to about 68.5gb, you'll lose a lot of quality but you can actually run it on consumer hardware https://huggingface.co/bartowski/xai-org_grok-2-GGUF

Anonymous
03/19/26(Thu)21:49:37 No.108410875

Anonymous 03/19/26(Thu)21:49:37 No.108410875

File: lolo.png (201 KB, 256x350)

201 KB PNG

>>108409972
>1752271170135420.jpg
KEK

Anonymous
03/19/26(Thu)22:59:19 No.108411190

Anonymous 03/19/26(Thu)22:59:19 No.108411190

>>108410440
>Can you imagine if OpenAI did this.
They also provide open source models.

https://huggingface.co/openai/gpt-oss-120b

Anonymous
03/19/26(Thu)23:12:22 No.108411261

Anonymous 03/19/26(Thu)23:12:22 No.108411261

>>108409972
https://huggingface.co/xai-org/grok-2

Anonymous
03/20/26(Fri)02:48:19 No.108412233

Anonymous 03/20/26(Fri)02:48:19 No.108412233

>>108410440
they only release the weights of old deprecated models too big for anybody to actually run
>>108411190
useless safetyslopped garbage

Anonymous
03/20/26(Fri)05:33:00 No.108412820

Anonymous 03/20/26(Fri)05:33:00 No.108412820

>>108409972
About 1GB per billion parameters at 8 bit quant.

Name
Options
Comment
Verification	4chan Pass users can bypass this verification. [Learn More] [Login]
File
Please read the Rules and FAQ before posting. You may highlight syntax and preserve whitespace by using [code] tags.