[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology

Name
Options
Comment
Verification
4chan Pass users can bypass this verification. [Learn More] [Login]
File
  • Please read the Rules and FAQ before posting.
  • You may highlight syntax and preserve whitespace by using [code] tags.

08/21/20New boards added: /vrpg/, /vmg/, /vst/ and /vm/
05/04/17New trial board added: /bant/ - International/Random
10/04/16New board for 4chan Pass users: /vip/ - Very Important Posts
[Hide] [Show All]


[Advertise on 4chan]


File: D6loMmkUYAAJIBf.jpg (202 KB, 1366x2048)
202 KB
202 KB JPG
Messing around with meme coding with qwen3.5 35b. How does this stack up compared to the paid stuff?
>>
>35b
it's trash
minimax-m2.5 on ollama is free
>>
>>108351401
27B is better.
>>
>>108351401
use dense model
>>
I feel as though there is something in this post that has not yet been addressed.
>>
File: file.png (1.99 MB, 1366x2048)
1.99 MB
1.99 MB PNG
>>108353125
what do you reckon that might be, anon
>>
>>108351401
>>108353245
isn't this miru tights?
>>
>>108353308
unfortunately the cosplayer herself is the real mystery...
>>
reverse image search found another one.

>>108352881
I could never get the bloody moe models to run. which dense?
>>
>>108353375
moe models are easier to run
unironically just use llama.cpp and ask whatever flavor of corpo LLMs for args with your pc spec lol

dense i mean 27B models, they will crush 35B-A3B any day for jobs like coding but you need at least 16GB vram for a good experience
moes are memes
>>
>>108353395
yeah i remember trying to get them running with llama.cpp and claude code hooked up to it via some router program. no end of problems. maybe im too retarded, its certainly possible.
kept running out of ram on 2x older 24gb cards.

Also is all qwen 3.5 just moe? The 27b versions are just quants? Also vision is just wasted data and training, so the code only version is still qwen 2.5 or something?
>>
>>108353528
~to 27B it is dense
from 35B-A3B they are all moe
and 27B is number of parameters, quants mean they have parameter precision compromised, does not mean lower params
and just use qwen3.5, not qwen3 coder

seriously just run 27b dense Q5 on a single gpu and that will be more than enough for you
>>
File: marina-amatsu_0785.jpg (132 KB, 1129x808)
132 KB
132 KB JPG
>>108353591
thanks anon

>>108353318
picrel
>>
>>108351401
>qwen3.5 35b
>How does this stack up compared to the paid stuff?
Kinda shit I guess?
You are using 1–1.5 years old stuff compared to the paid models.
You're also missing out on all the most advanced agentic integrations and tools.



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.