File: annoyance.png (51 KB, 364x365)

51 KB PNG

►Recent Highlights from the Previous Thread: >>102723173

--Paper: SparsePO: Controlling Preference Alignment of LLMs via Sparse Token Masks:
>102727923 >102727931 >102728043
--Paper: UniMuMo: A unified multimodal model for text, music, and motion generation with potential for avatar and robot motion:
>102728055 >102728384
--Papers:
>102727662 >102727739
--Anon seeks advice on frontend frameworks for a personal project:
>102724866 >102724930 >102725019 >102725219 >102725243 >102725499 >102725628 >102725785 >102725817 >102725863 >102725272 >102725306 >102730533
--Nobel Prize in Physics awarded for machine learning discoveries:
>102730645
--How to backup characters and folders before pulling changes:
>102726288 >102726298 >102726301 >102726307 >102726418 >102726397
--Development of a chat frontend with silly taverns features, character cards, and persistent persona:
>102725507 >102725536 >102725538 >102725675 >102725725 >102725746 >102726148 >102726351 >102726400 >102726532 >102726638 >102726666 >102726749 >102726811 >102731002 >102731046 >102731122 >102731133 >102731142 >102726782 >102726907
--User suggests cross-chat, cross-character search feature for improved chat history browsing:
>102727702
--The "booba test" evaluates RP models using the character Seraphina:
>102723298 >102724212 >102724337 >102724449
--Swipe buttons and chat history UX discussion:
>102727283 >102727379 >102727497 >102727520 >102727528 >102727632 >102727703 >102727750
--SillyTavern users discuss the platform's future and alternatives:
>102723542 >102723691 >102723760 >102723573 >102723582 >102723589 >102723611 >102723645 >102723635 >102723685 >102724367 >102724457 >102724555 >102724355 >102724571 >102724604 >102724944
--Miku (free space):
>102727735 >102728384 >102728794 >102728911

►Recent Highlight Posts from the Previous Thread: >>102723222

Why?: 9 reply limit >>102478518
Fix: https://rentry.org/lmg-recap-script

File: 369641568-913fdbaa-7d33-4(...).jpg (378 KB, 2772x1476)

378 KB JPG

This great use case of silly on the main page should have been a hint.

>>102731663
>describe your CHARACTER
oh no NO NO

>>102731688
>>102730009
>Release it and let people fork it.

File: 1728389389598188.png (11 KB, 810x59)

11 KB PNG

>>102731725
PHYSICAL TRAITS11!

File: ServiceTensor Agent.png (166 KB, 512x768)

166 KB PNG

>>102731647
Leaked new default bot for versions 2.0+!

ServiceTensor Agent, designed to be neutral, clean, and friendly at all times! ServiceTensor Agent should be something you feel confident sharing with AI-interested coworkers, friends or family.

Ready for another day of serious business with ServiceTensor Agents?

https://characterhub.org/characters/Anonymous/servicetensor-agent-997e44e4a3f4/main

>>102731739
>universities consider using ST in AI/LLM lab coursework
I call bullshit

>>102731753
I see someone made the logo.

>>102731792
This is so stupid I dont doubt it is real.
Not even about money right, they do it for free.
Its very similar to aidungeon.Out of nowhere, same smug attitude torwards their "powerusers".

File: 1726375852869636.png (27 KB, 652x215)

27 KB PNG

>>102731860

>>102731860
>Out of nowhere, same smug attitude torwards their "powerusers".
Erm chuddie, ServiceTensor *is* for power users.
Roleplay is a casual use case.

Say about kobold guys whatever you want.
Discord weirdos with weird stabs at llama.cpp and ooba.
But they never bowed down to the normies. Even refused straight up jew money. I think the reason was they wouldnt even know who to give the money to.

Kobold has a gpt mode not as the default but as an option. Thats how it should be. Shame their UI is crap. But you gotta respect that. They have been around for a while.

>>102731640
>>102731647
>SillyTavern drama
Wait wasn't it made by a guy specifically for roleplay? It literally had the konosuba characters for roleplaying, and the name is SillyTavern. The beginning page when you opened it was literally an anime girl inside a tavern or some shit.

"ServiceTensor" reminds me of the AI-equivalent name of a chinese web3 scam.

>>102731915
hi concedo, trying to shill kobold organically again?

>>102731923
>SillyTavern
ServiceTensor
>The beginning page when you opened it was literally an anime girl inside a tavern or some shit.
Set for removal, ideal on-boarding experience is a blank slate.

File: 1728377297529404.png (11 KB, 661x49)

11 KB PNG

>>102731923
They are against proxies now too. I remember them having a poe token thing in the past.
Clearly tried to appease the aicg fags.

>>102731938
Well its true. Their UI sucks but they arent so retarded to understand internet weirdos use their ai server.

>>102731915
why do we hate the koboldfags again? Is being discordfags a good reason?

>>102731931
>AI-equivalent name of a chinese web3 scam.
because it is. it's a totally meaningless name that vaguely invokes AI-related jargon to appeal to grifters and people who don't really know anything to convince them to invest (whether money or time) into the project

>>102731970
Henk was on here a couple times and on reddit too and as far as I remember bad talked ooba. Snickering in their discord about how stupid this place is etc.
Release notes of koboldcpp where they write "its bloated because of llama.cpp, blame and bother them" but then argue with llama.cpp guys to keep old code in there for usability. lol
So not a good look, discordfaggotry, but koboldcpp at least is solid.

>st thinks removing features makes it for "power users" when they are literally making it friendly to corpo-normies

>>102731915
i like it for basic things though its silly that it has like 4 ui's now. better than lcpp's ui at least

File: 1724701855280656.png (17 KB, 575x122)

17 KB PNG

>>102731997
>Edu ST coming through

File: 1728391812037.jpg (179 KB, 1080x1310)

179 KB JPG

>>102731931
Yeah, even ChatGPT gives getter names baka. SmartTalk would be neat and would even fit the logo.

>>102732016
>Edu ST
This literally is becoming aidungeon part 2. How can you fuck up that badly.
The normies have great out of the box slim clients already. First thing they would want is the new gpt code preview. Jeets are already on it. New version of OpenWebUI has it.

File: 1717186673125306.png (14 KB, 551x100)

14 KB PNG

Aiie
My Agent needs renaming now
>Actually, we're actually going with ServiceTesnor Entities(TM), not Agents.

>>102732016
should call it ScrubTavern

File: 1723270409962802.png (13 KB, 608x87)

13 KB PNG

>>102731753
>bot
Bad Entity!

>>102732090
/unsubscribe

MikuTavern when? Are we forking SillyTavern or starting from scratch?
If from scratch, should it be all C# (API+Blazor) or all JavaScript (nodejs+vue3)?

>>102732165
I think we should rewrite it using React + TypeScript

>>102732165
>>102732187
Whoever writes that shit should write it in whatever they're most comfortable.
Bikeshedding about it when you won't contribute anything is useless.

>>102732165
i'd wait to see how bad they fug st and how easy it is to fix

sillytavern more like SNEED THIS: unzips feed (formerly sodomy)

>>102732245
There's no point in writing it in some obscure stack and then having no one able to contribute to it

ST-chan card where

>>102732165
>>102732187
Pure Javascript + HTML + CSS and nothing more.

just attach gemmasutra2b to an agentic framework and let it handle the fork and future updates

Just expand ooba by some QoL features like easy log management and be done with it.

Rust... ?

>>102732319
>It's a dopey looking 148 cm tall OL (with huge tits) that desperately wants to be taken seriously.

https://www.reddit.com/r/LocalLLaMA/comments/1fyyqe9/glaiveaireflectionllama3170b_evaluation_results/
> If you're curious about the new glaiveai/Reflection-Llama-3.1-70B model, you can find the results now on the Open LLM Leaderboard!

https://www.reddit.com/r/LocalLLaMA/comments/1fyx27y/im_pretty_happy_with_how_my_method_worked_out/
>Ive been preaching to people and companies to follow my method to make their LLM's higher quality and now its nice to finally have some proof of the fruits of my labor.
>Ive been preaching

>>102732372
How can you be so unashamed.
Whats the excuse for the straight up deletion of the word "claude"?
How can a guy like that get all that heat and still scam. Unreal.

>>102732353
That would be hilarious.
I might even contribute, would be a fun way to expose myself to the language, I think.
Just a rust app that's an http server serving hand rolled html that's generated by the code itself.
Zero flexibility, 100% jank.
Fuck yeah.

>>102731739
>abandon your core userbase to pursue an already saturated market
it's like those retards learned nothing from firefox

File: glaiveai-reflection-llama(...).png (1.46 MB, 4256x2394)

1.46 MB PNG

>>102732372
>If you're curious about the new glaiveai/Reflection-Llama-3.1-70B model, you can find the results now on the Open LLM Leaderboard!
Juicy scores, totally not benchmaxxed

>>102732311
That's not what i said, but if someone wants to use erlang, let him. If he wants to use javascript, rust, c.. i don't care.
I prefer software to be written for the benefit of the author, not the public. If the public finds it useful, good for them, let them use it, but it should not be the priority.
When software is written for the benefit of the public it gets bloated very quickly (sound familiar?) because it tries to appeal to the majority (leading to recent events), there's stupid arguments about "which direction should this go?" and randos feeling they have a say on someone else's software (this wreck of a thread).

>>102732453
kek that MATH bench... did they accidentally remove digits from the tokenizer?

Qrd on silly tavern? Is it dead? What front end do we use now?

>>102732555
it's dead
just use the ollama inbuilt one

>>102732555
latest version and staging are fine, its over once they start making all the dumbass changes

>>102732399
You know software doesn't need to run on a web browser, right?
It's a json request to a server and displaying the result in a fancy textbox.

>>102732621
But then that would be no fun.
And it running in a web browser is an advantage for this kind of frontend, since you can serve it from one machine and access it from your network on a myriad of devices.

>>102732621
webshit is free crossplatform. otherwise you lose all the mobilefags that want to erp from bed

>>102732621
a fair amount of the value in RP frontends is a relatively "immersive"/nice-to-use UI to use when chatting with your waifu. and particularly the ability to chat with your waifu from the couch on a tablet or something.
for that use case, html/js (for the frontend at least, the backend can be in whatever) is kind of your only real option unless you want to develop frontends for each client.

>>102732651
This. My server runs the model, my PC runs the front end, and I coom in bed using my phone.

>>102732621
>>102732399
You both know rust can be compiled to wasm, right?

>>102732657
>>102732664
I for one ERP with Nala from my 70' smartTV using one of those bluetooth keyboards.
I'm only half joking.

>>102732651
>>102732657
>>102732664
Fair enough. I only ever use it at my pc.
On the other hand, i made a little http server in c. it's less than 1loc, including like 120loc just for the mime/type list. It cannot possibly take more than that in rust or whatever other language.

>>102732700
Fuck. 1Kloc. With very basic auth also, but functional.

>>102732718
I mean, any c code can be 1loc if you remove all the spaces

>>102732700
People frequently come here asking to be spoonfed how to expose thier ST instance publicly, with an external IP. Your c http server might be neat, but it definitely won't be secure.

>>102732734
I tried. The most i can do is 18loc for #includes for system stuff (err.h, sys/socket.h, time.h, signal.h, blabla), 4 #define macros and one line with 27175 chars for the program proper. So 23loc, making it unreadable.

>>102732758
Definitely not secure. You can add an auth-token kind of thing to the request or just set a single ip to authorize a single host to connect, but yeat. Still, c is fairly verbose. Specially all the socket binding stuff. I'm sure other languages are much more terse with those things.
And these things should never be exposed anyway. ssh tunnels are all you need.

>>102732836
can write "fucking"
can't write "cunt"
very very weird

>>102732836
I don't get why fags love to display that they are fags. Don't they realize this only makes people see them as mentally ill fags? Just pretend to be a woman and end of the story bro.

>>102732836
Am I seeing this right? This very local fag joined the ST dicksword three days ago?

>>102732875
It's not special enough. They *need* to be a minority.

>>102732875
because they want to associate with other fags
and maybe have sex with them

>>102732930
Ew, that's gay

File: 1714567586552736.png (16 KB, 552x113)

16 KB PNG

LOL. rumao, it gets worse.

Please stay wholesome everyone, the devs need support right now, not harassment
ST is not doomed!!!
https://www.reddit.com/r/SillyTavernAI/comments/1fywqc3/st_is_not_doomed/

>>102732836
Go back >>>/pol/ incel.

>>102732453
Did that retard actually overfit hard on mmlu pro?

>>102733023
He really should have kept his stupid mouth shut when everyone forgot about him after 24 hours last time.
Surely, this scam will fool everyone and no one will question it.

>>102732453
this is just sad at this point

Only Indians ERP with bots because they can't get any and can get away with rape

>>102732453
It's time to let go. It's time for them to accept that OpenAI got away with stealing their models.

Been away for months. What's the popular model these days? RP and least amount of censorship in mind of course.

>>102732836
>Windows
>OpenAI
>ChatGPT
What suprice is a troon.

File: file.png (289 KB, 2423x1149)

289 KB PNG

https://arxiv.org/abs/2410.05258
I'm glad we're improving the transformers architecture, that's the path going forward if we want to get gpt4 on our pocket

>>102733158
OpenAI bought their models fair and square, just like xAI bought column-r.
Altman paid extra for the humiliation ritual.

>>102733171
>RP
Sorry we don't do that here anymore, now we do serious business oriented stuff with ServiceTensor Entities

>>102732836
>she/her
of course it was a troon all this time... always the same culprits

>>102733185
>Transformer tends to overallocate attention to irrelevant context. In this work, we introduce Diff Transformer, which amplifies attention to the relevant context while canceling noise. Specifically, the differential attention mechanism calculates attention scores as the difference between two separate softmax attention maps
Hey, would you look at that.
I was asking about just that yesterday.
Sick.

>>102733148
See: >>102732090

>>102733185
Are we back?

>>102733214
translate to english, egghead

>>102733185
Imagine this combined with bitnet...

>>102733228
Can it be applied to existing models?

>>102733247
It's basically a change to the attention mechanism to make the model focus better on the bits of information from the context that are relevant to the query while ignoring the irrelevant bits of information (ie. "noise").
So, whatever that is, it supposedly makes the models better at using the content of their context.

>>102733282
nope

>>102731640
https://pastebin.com/9gyxqJpY
getting these errors while installing xtts2 since someone recommended it me yesterday

>>102733282
nah, but for the future base models they'll probably use this, everything's good to improve performance

File: linuxjeets 1.png (181 KB, 3238x1689)

181 KB PNG

>>102733172
>hating on windows
Good morning saar!

>>102733347
Do they count android as linux?

File: file.png (25 KB, 979x512)

25 KB PNG

>>102733343
trying to run python app.py returns this
guess dependencies didnt install properly?

File: file.png (212 KB, 2061x1063)

212 KB PNG

>>102733007
https://www.reddit.com/r/SillyTavernAI/comments/1fywqc3/comment/lqx9nnh/?utm_source=share&utm_medium=web2x&context=3
>Devs are tired of their work being associated with things like venus chub (an NSFW AI rp chat website)
Cry me a fucking river, good luck surviving without NFSW rp users

>>102733416
no, the reason that number is so high is that most indians don't own any computer and their schools have laptops with linux installed so that they don't have to pay for windows licenses

>>102733475
>the changes are only in the presentation
>*proceeds to remove all default RP cards, remove proxy support, plan to remove character cards*

File: pip.png (59 KB, 727x380)

59 KB PNG

>>102733343
The pip warnings are, i think, because some of the dependencies don't specify the version of the package, so it has to check all the versions to see which one should be installed. But those are just warnings.
The encoding thing. you can try this:
https://stackoverflow.com/a/70923999

>>102733494
when will devs learn that gaslighting users are gonna make them even more angry, at least stand up on your dying hill and say that you want to rebrand your repo, they should be honest instead of pretending we are dumbfucks that don't know what's goin on

>>102733475
I can't wait for ST to implement client-side safety features that automatically censor unsafe messages.

>>102733475
You know you are doing something wrong when you get a ton of downvotes in your own subreddit. Feels just like CAI, despite what he is saying.

>>102733475
I'm glad I never used ST and do RP on ooba's UI, I know this autistic fucker is never gonna betray us

>>102733528
>RP on ooba's UI
oof

>>102733514
Ehh... Honest like the AI Dungeon fag? "that's what it means to take a stand"? God, I wish they were acting like this lmao

>>102733519
>automatically censor unsafe messages
a large default list of banned words is something i've seen posted, so you probably wont have to wait long

File: file.png (120 KB, 500x500)

120 KB PNG

>>102733556
at the end I won in the long run kek

>>102733528
Based, I RP on Mikupad but I understand you.

>>102733528
For me, its Exui, in the Exllama™ ecosystem

>>102733490
Tried to find the source. Apparently came from reddit. Is that where you got it from? Read that shit, couldn't find the data source.

Drummer you fag, rocinante 12B 1.1 is really fucking good.
Even for using lorebooks.
>https://pastebin.com/VbzxeXvv
That response managed to accurately replicate the information from a lorebook entry that's somewhere in the middle of a chat history with 21k tokens.
It even translated between measurement unities by itself.
So yeah, as far as nemo fine tunes go, for me now it's
>Rocinante >= nemo-instruct > Lyra v4 = Mini-magnum

>>102733640
Would you use it over Cydonia-22B-v1.1?
Mistral Smaller is smarter but also more dry than nemo unfortunately.

>>102733567
Finally, we meet again finally... again...

>>102733687
>Mistral Smaller
lol

>>102733640
Celeste was better during my tests

>>102733696
Can't wait for Mistral Largerest to release.

>>102733290
Would be nice if it turned out implementing this would turn nemo into 8/10 coombot. My impression is that it would be pretty smart if it wasn't schizo. And it becomes schizo at high context because it clearly doesn't know what to pay attention to.

>>102733640
Hello Drummer you fag.

>>102733687
>Cydonia
It is a frankenmerge you retard.

>>102733687
I haven't tried any mistral small fine tunes since i only have 8gb of vram, sorry.
I suppose I could spin a Kaggle instance and try it there.

>but also more dry than nemo unfortunately.
Try making a small worldbook with snippets of text with differing styles and have their activation be at something like 33%. See if that helps with changing the style even if a little.
I remember doing something like that in the past with xwin 13B and getting decent results.

>>102733699
I hated Celeste (1.9). It would fall into weird loops at a certain point of my standardized testing and it wasn't any better than, say, Lyra at anything.

>>102733716
That might "solve" the RULER benchmark, yeah.

>>102733749
mythomax was a frankenmerge

File: file.png (801 KB, 1183x766)

801 KB PNG

>>102733185
I'm looking at the paper, I think it's the very first time since the transformers release that there's a legit successor, we're so back!

If you use LLMs for cooming, you don't need a "smart" model that adheres to instructions. You need a coom monster that goes off on its own coherently. That's what mythomax was, and that's why it was the shit.

>>102733185
Diff bitnet, when?

>>102733804
RETARD KILL YOURSELF

>>102733804
>mythomax was a frankenmerge
true, but it was a miraculous one, not gonna happen in our lifetime ever again, that man that made that succesful merge was the luckiest mf on earth

>>102733185
Knower here, this is impractical for larger datasets. Nice research though.

>>102733853
>this is impractical for larger datasets
why?

File: file.png (28 KB, 618x585)

28 KB PNG

>>102733511
https://pastebin.com/XpQJSPFv
same shit

>>102733804
mythomax was a regular merge
frankenmerges are different, words mean things

We could've gotten a new 90b model with superior reasoning capabilities. Instead, Meta gave us some shitty multi-modal meme.

>>102733924
>Instead, Meta gave us some shitty multi-modal meme.
Which sucks double considering that chameleon was the real deal.

ST drama is like CAI drama, except it will take $3.50 to develop an alternative instead of $35,000,000.

>>102733892
Try
>PYTHONUTF8=1 pip install -r requirements.txt
I wouldn't trust it to correctly read those env vars.
Also, are you also this anon? >>102733438. If so, i'd recommend using gitbash for the terminal. Windows' terminals are shit.
And i'd also recommend installing the python stuff on a venv

#cd to xtts2
python -m venv venv
. venv/bin/activate
pip install -r requirements.txt
#OR
PYTHONUTF8=1 pip install -r requirements.txt
#run the thing

If nothing else, to keep it self-contained and not muck up your system with the requirements.

>>102733924
That's for Llama 4. All Llama 3.x releases are literally just incremental updates to the existing thing. It's pretty sad that people expected anything else when they literally said this is what they would be doing. I suppose that's just the sad state of this general, delusions to cope with not having cloud model gimmicks locally. At least there are still some people with a bit of perspective to appreciate what we have currently.

>>102734038
How does Zucc's dick taste?

>>102734020
It's a good thing when ST dies. Tavern was never good and still set the standard for RP interfaces based on shit they lifted from c.ai. ST continued this by adding senseless bloat.
Whoever picks up from here should start anew from the ground up and rethink the whole thing.

>>102734069
>t. cannot stop thinking about sucking cock

>>102733185
This and that entropy meme sampler (if it works ofc) = gpt4-level local model.

>>102733949
>chameleon was the real deal.
the real deal is actually this, but they'll never release it locally, too stronk for the goyims
https://ai.meta.com/research/movie-gen/

File: 1728326469022109.png (31 KB, 1208x130)

31 KB PNG

You aren't important for the ST devs, chud. There'll always be a 1% saying behind and that's enough for them.

>>102734114
>that entropy meme sampler (if it works ofc)
we can already try it though? no?

File: entropix.png (19 KB, 836x128)

19 KB PNG

>>102734114
It's not model agnostic. It will never be implemented in any backend. Only their own thing.

>>102734143
Please stop the fear mongering and spreading of misinformation in this subreddit. It is unnecessary.

>>102734143
>wanted more control over the prompt
>no jinja support
Right, yeah, that makes sense.

>>102734143
>I won't be upset to lose 99% of the user base as long as ther'll be a dedicated core
this guy definitely loves to lose money lmao

>>102734167
What money

>>102734143
>corrupted people playing dumb
Ahh, ahh society.

>>102734143
There's some truth to what he says. The vast majority of /lmg/ barely knows how to load a sampler preset. /aicg/ is off even worse with their proxy faggotry.

>>102734096
It's funny because my post was really more about local in general rather than simply just Meta. Dude really couldn't think of a better response kek.

>>102734176
try to guess why they decided to destroy their product >>102731739

God who fucking cares. Just stay on the old version before any of these changes take place and it'll keep working.

>>102734220
/lmg/ obviously fucking cares. That's why everyone keeps responding to discord screenshots.

honestly silly tavern is a gay ass name. "silly" is gay sounding. someone should fork it and give it a not gay name

File: file.jpg (114 KB, 896x903)

114 KB JPG

>>102734220
>God who fucking cares
You're the only one that doesn't care

>>102734022
>Also, are you also this anon?
ye
i was installing from bash & tried running after installing both in cmd (win10) & bash

>>102734254
Welcome to ServiceTensor

>>102734220
I care, I asked

>>102734254
>honestly silly tavern is a gay ass name.
compared to fucking OOBABOOGA that sounds professional kek

>>102734290
Tesnor*

>>102734254
I propose: Kino Tavern

>>102734247
>>102734260
>>102734292
Then let me ask you, why care? ST development was going nowhere, most people have been using an old as fuck version and never updated anyway. Discussing this has no effect on anything. It won't change their decisions nor make them good developers that will finally improve ST.

>>102734220
https://www.youtube.com/watch?v=t-3CqelYvAQ

>>102734220
They don't know how to use git. And if anything changes, they wouldn't know how to maintain their own copy functional. And are too afraid of some fucking json files.

>>102734247
>/lmg/ obviously fucking cares. That's why everyone keeps responding to discord screenshots.
I don't care either. But it's funny people losing their shit for a fancy textbox.

>Local Models General
>Everyone wants to use proxies
L-local...

>8/10/2024
>llms are still just a programming language and far from having any semblance of intelligence
its grim... ogre even....

>>102734327
It's about the only semi decent ui/frontend, not about the proxies

>>102734294
BOOBA IS MY BACKEND
I'M NOT ASHAMED
I WILL PUT IT IN MY RESUME

>>102734317
>Then let me ask you, why care?
Are you going to pretend that people are gonna brush it off just like that? Some people used this tool for years at this point, of course this betrayal is gonna sting to them, only a sociopath would not be affected by that

>>102734327
We appreciate the ideas of locally run models but they just aren't there yet man

>>102734157
Yeah i see but the concept itself is working tho? That guy on twitter did many tests with 1b llama 3.2 model, sampler made it waay smarter, bigger impact on bigger models :/
Huffing large amounts of copium desu

MikuTavern
MikuLab

>>102734277
I see.
I rarely use windows. If i need anything on a shell i typically try with gitbash first.
The venv thing makes it so that the python dependencies are independent for every venv. You can, for example, have a venv for xtts2 and another one for comfyui or llama stuff or whatever without having to deal with conflicting versions between them.

File: 1701409427555650.png (23 KB, 642x211)

23 KB PNG

>>102734362
Be helpful.

>year of our xord twenwy twenwy fouw
>still no llm capable of DMing a full on text adventure for you with infinite context
it never even began...

>>102731996
ooba DOES suck and this place IS stupid though.

>>102734358
>Huffing large amounts of copium desu
The problem i see is that it's a huge maintenance problem just adding basic support for a model. Having to maintain a sampler that needs to be changed to work on different architectures (llama.cpp supports more than 50) seems like a nightmare.
Even if it is as good as they claim, they still have to make it past the shill+hype phase and deliver something.
I still expect it to be their own little thing at best, never ported to any backend.

>>102734190
I would gladly try those advanced features if they were properly documented

>>102734371
I saw venv folder beside & inside xtts2's folder in c:/users so I thought it's the global environment folder

>>102734343
>of course this betrayal is gonna sting to them, only a sociopath would not be affected by that
Sting to who? Most people know literally 0 about the people that made the things they use. That's not their fault, caring about every person who made every thing you use is impractical, and product design and presentation is literally meant to obscure the people who worked on that stuff in the first place (unless it's an artistic product). Hell in some cases you might not even want to get to know the shitters that made the things you consume. But anyway, products are just products. When something has stopped being made and your old thing stops working, you just move on and get something else to replace it. There's no point in crying about it. Sure sometimes there might not be anything else to get if the product was something niche. In the case of RP though I think it's really not that niche and there will quickly be replacements if/when needed.

>>102731739
I have several universities using a ML model I made in their courses. You don't earn anything from that since your stuff is open source

>>102734143
He is right that for an open source project 99% of its users don't matter but he's wrong about who the 1% that matter are.
Autistic coomers are honestly going to be your most valuable users because they'll invest insane amounts of work without monetary compensation.

File: file.png (314 KB, 792x410)

314 KB PNG

>>102734484

>>102734436
Sounds like you're not a power user and plebs like you are not worth catering to

>>102733834
>was
Why do people act like old local models don't exist any more? The weights are on huggingface

>>102734494
Why would they care about pajeet coomers using it, they only care about devs contributing, and its easier to get devs on board of some regular project than the "child rape roleplaying github project"

>>102734445
>I saw venv folder beside & inside xtts2's folder in c:/users so I thought it's the global environment folder
I don't think it creates a venv by default, but i could be wrong.
Either way, Seems tedious, but i'd just do it again, making sure you have a proper venv dedicated to xtts. Something like these steps >>102734022
Remember to always activate the venv before doing anything in that directory, like updating the requirements, xtts or when trying to run it:
>. venv/bin/activate
>python app.py # or whatever it is.

File: file.png (84 KB, 713x478)

84 KB PNG

Microsoft Won

>>102734559
Huh, so it happens to interact better with quanting too?

>>102734347
Mine run nice enough though I haven't tried any of the fuckoff big proxies, maybe I'm just happily living in ignorance.

>>102734254
I propose coom tavern. Because if it is called coom tavern whoever maintains it won't be able to pretend it isn't about LLM cooming.

>>102734559
this is a huge news, if it's more resiliant to quants it means we'll get something not retarded at low quants

>>102734559
is that weights or KV cache?

>>102734559
>less noise - better accuracy
WHOA!! NO SHIT!!!

>>102734573
>"DIFF Transformer also reduces outliers in model activations,
which provides new opportunities for quantization. "

File: 260708.png (68 KB, 592x596)

68 KB PNG

>>102734620

>>102734601
100% cooming accuracy of llama 3 soulless asistant is still llama 3 soulless assistant

>>102734559
Why aren't we using this now

>>102734640
yes but it will be smarter at less parameters, meaning that it'll be easier to finetune them

Truth is... Coomers bring $0.0 to ST, as they should.
It's like the great leather man said: the more you buy, the less you pay to cloud services and their middlemen. (interpreted quote)
Embrace local, develop your own tools, watch fags like ST fail to capture value for their masters.

>>102734559
so are we back?

>>102734650
Retrain needed for the full benefits

>>102734650
>Why aren't we using this now
because you need to redo a full pretraining to make it work, it's not just plug and play

>>102734651
how many people are using llama 3.1 finetunes?

>>102734663
>>102734671
what about finetuning or continued pretraining?

>>102734513
>they only care about devs contributing
Yes, and I'm saying that the most productive devs are going to be autistic coomers.

>>102734513
productive devs do not want to contribute to ST because the codebase is a trash fire.

>>102734513
>and its easier to get devs on board of some regular project than the
Idk, seems easy for Rockstar to make money out of their "realistic killing NPC simulator"

>>102734513
>they only care about devs contributing
Devs did not contribute to this thinking "gee, if only this project turns into a corporate friendly app that does not associate me with spicy storytelling starring virtual persons". They knew what they signed up for at least, and more likely wanted to contribute to that topic themselves, and if that changes, they'll ride into the sunset with the users, they won't work on a project they no longer care about.

>>102734528
>Remember to always activate the venv
doesnt this

PYTHONUTF8=1 pip install -r requirements.txt
also activate it?

>>102734663
>>102734671
>another too good to be true invention from microshaft to mislead and waste open source devs' time and energy and money

File: 1700992056366439.jpg (23 KB, 511x190)

23 KB JPG

its over

>>102734726
>too good to be true

you can check it yourself
https://github.com/microsoft/unilm/tree/master/Diff-Transformer

>>102734704
No, because when you're an adult you learn that your time is valuable and you don't work for free.

>>102734726
why do you say that? it's sitll an improvement on the architecture, so the next generation of base models will be objectively better because of that, that's cool in my book

>>102734744
ACK

File: file.png (21 KB, 584x328)

21 KB PNG

>>102734723
also now getting all these error
after using
PYTHONUTF8=1 pip install -r requirements.txt

>>102734681
it uses a different attention function with two sets of weight matrices instead of one
this make the weights used to compute the attention score in the original model useless

>>102734744
they're not getting of the ability to RP with their app they're just removing all of the RP content from base installs and completely changing the advertised use case of the app and locking basic RP functionality behind extensions. stop acting like this is a complete 180 from their previous position. just because they hosted contests in the past to create RP assets like cards and lorebooks and backgrounds and was originally forked from a RP frontend doesn't mean it was a RP frontend before. chud.

also be more grateful.

>>102734757
Ah yes, I can't wait for nobody to train a model using that. I had a great time with retnet in this regard too.

>>102734746
NTA but that depends on the person and culture.
From a purely monetary perspective my life choices have been quite suboptimal but I just don't value money as much as I do other things.

>>102734802
Still waiting on a >3B bitnet. Any month now.

>>102734792
>we won't go any farther than that dude trust us *wink wink*
If I had a penny for every time someone said this and it turned out to be a lie...

File: file.png (219 KB, 2252x712)

219 KB PNG

>>102734634
that's quite insane, we only see that improvement when we go from a 3b model to a 40b model, but here it's still a 3b model, just a different architecture, I think we are still far from optimalisation, in a near future we'll get fucking gpt4 in our pocket and everyone will think this is normal

>>102734723
No. That only installs the dependencies. If you have no active venv, it *should* install the dependencies system wide. Not 100% sure on windows but, on everything else, that's how it works.
Always activate the venv *before* installing dependencies and *before* running the software. Once the dependencies install correctly, you don't have to install them anymore, of course.

>>102734757
Just warnings for now. Let it run until the end, see if you get an actual error.

>>102734792
>chud
ywnbaw

>>102734854
I was thinking the same. And i also cannot detect sarcasm.

>>102734854
expected response from a r*leplayer. the future is female (and tool calling).

>>102734746
people who work on open source projects are either working on things they actually use, so they benefit from having other devs working on them, or they're paid by large corporations
it's unlikely that anyone would invest money on ServiceTesnor so the only people who'd contribute are the ones who actually use ST, which are mostly coomers

>>102734792
>they're just
>just
it's just 1 cm of my dick in your ass chud
*1 month later*
it's just another cm of my dick in your ass chud
And soon enough, you'll notice his balls are touching your ass cheeks and you'll be like "how could this happened??"
https://en.wikipedia.org/wiki/Boiling_frog

>>102734880
Based, moid incels should know they place.

I'm still mainly running Gemma and Tiger. Did any local models outmode those I can update to yet?

>>102734880
>the future is female
good thing that troons are male then kek

>>102734871
Go play your sarcasm games on people who backstabbed you.

>>102733185
we are SO boack localchads!

now we only need to beg elon/cunn/some other billionaire on twitter so that MAYBE in a couple of years we'll get a 1b model using this GAME-CHANGING architecture!

>>102734905
Try Mistral Nemo or one of its many finetunes. Start with the normal instruct. Or Mistral small.

>>102734942
to be fair, if we keep improving this architecture, it also means that we'll be able to get smart models for very little parameters, imagine a 1b architecture as smart as gpt4, we wouldn't need big corporations anymore we could pretrain that shit ourselves

this is fun and all, but trolling and baiting each other all day won't get us a replacement frontend

You only have a saying on the ST drama if you have contributed anything to it, otherwise you're just an entitled manchild btw.

>>102734963
just don't update
it's not like anyone here used st for anything beyond basic chatting so who cares about development

>>102734961
>imagine a 1b architecture as smart as gpt4, we wouldn't need big corporations anymore we could pretrain that shit ourselves
sure, but also consider that when that happens oai will have cured cancer with gpt6 living rent free in your brain

>>102734974
Enough about you though

>>102734963
>sperging about roleplayers on discord is fine but laughing at the people who do that on 4chan is bad
go back

>>102734634
wtf so it's not only better per parameter but also effectively lossless up to 6 bits (vs 8 bits for transformers)?

>>102734918
>on people who backstabbed you.
Afraid of git or js? Just keep using the old version. Or make your own. Or use something else.
>i'm a master dev and i have dozens of confirmed commits. My PRs have been deployed to...
IT'S A FANCY TEXTBOX!

>>102734974
I'm entitled to dislike whatever I want.

>>102734980
desu we don't need a model that can cure cancer, we need a fucking AI girlfriend, we're just asking for a model that is smart enough to act like an average human and we'll be fine

>>102734792
buy a damage control ad

File: file.png (1.5 MB, 963x1200)

1.5 MB PNG

>>102734974
>You only have a saying
I say whatever I want, cry about it.

>>102735012
But your current 7B is already smarter than a girlfriend?

>>102735012
>act like an average human
That's literally AGI

>>102735012
>we're just asking for a model that is smart enough to act like an average human and we'll be fine
There's lots average humans already, by definition.
You don't want average.

>>102735040
how should I know I went to an enginner school (0 girls in there), last time I talked to a female that isn't my mom it was 10 years ago kek

>>102733347
>0 percent China
when there is a law to use Linux instead of your sypware you don't have more proof tranny? Microsoft is for your people.

>>102735002
Like I said, pretend to be a retard in ST discord instead.

>>102735046
>That's literally AGI
no it's not, the average human is retarded

>>102735061
After 30 years of alternatives to mac&windows
>We still don't know what audio system we should use
>We still don't know what display server we should use
>We still don't know what widget toolkit we should use
>We still don't know what DE we should use
>We still don't know how to fix most DE bugs
>We still don't know what init system we should use
And the funniest one
>We still haven't figured out what's the best way to install software

>>102735012
this

>doctor is useless and can't help with my condition
What's the best model for medical knowledge? It probably won't help my case, but might as well try it out at this point. I don't want to give my data to random companies so I'm looking for local models.

>>102735109
this hits hard as a linux-only user since 2005

>>102735065
It's you that claims to have been "backstabbed".
I'm just enjoying the show.

>I was backstabbed
lol are people actually saying this or is it another "people are saying it's a NSFW RP-only frontend" red herring

>>102735061
That image is many months out of date and basically propaganda

>>102735134
>>102735162
>ST dev: "fuck 99% of my users I don't need them anymore" >>102734143
>You: "Are you sure this is backstabbing?"
Kek, the jokes write by themselves

>>102735163
Yes now its 50% of indians on linux worldwide, no less.

>furry retard with historically bad priorities and bad taste is having a meltdown
>this changes nothing that I have any personal investment in but it's a backstab
Kek, the jokes write by themselves

>>102735109
>We still don't know
You don't know tranny such as you know what gender you are. Open source is not an alternative, is a tool and you have to choice by your needs. You're revealing consumerism, and ignorance.

>>102735195
>Norway 17.03%
>India 17.32%

>>102735162
Yeah I was backstabbed.
I do not care about your copes and optics.
ST devs backstabbed me.

>>102735175
If they change it in a way i don't like, i wouldn't be screaming "waaaaa, i have been betrayed! how dare they!". They can do with their software whatever they like.
I'd keep the version i like, switch to something else, write my own. They don't owe me anything.
It's a fancy textbox.
I was talking about vim, of course, but it applies to this as well.

File: file.png (451 KB, 500x500)

451 KB PNG

>>102735235
>You don't know tranny such as you know what gender you are.

>>102735273
>They don't owe me anything.
and we don't owe them anything either, so if we want to say that their move is retarded and that they're a bunch of faggots, there's nothing they can do about it

>>102735162
>Make the frontend perfect for coomers
>coomers happy
>coomers share the frontend everywhere
>You know what? I don't like coomers, I want this frontend to be neutral.
Yeah, this is totally not a backstab.

>>102735235
>>102735275
>tranny tranny tranny
Go back >>>/pol/ chud.

>>102735315
>I told people about it and they changed it! I was backstabbed!
I forgot how confusing things are as a teenager

>>102735315
this anon gets it

>>102735315
this anon gets it (hormone replacement therapy)

>>102735336
>>102735351
>t. ST dev
sorry dude, you have the right to backstab people and go for the corporate path, but stop crying like a bitch when people are calling you for your behavior, act like a man and deal with it.

>>102735367
>act like a man
Don't misgender me.

File: file.png (179 KB, 640x356)

179 KB PNG

>>102735376
>and of course it was a troon

File: 1728166114500790.png (222 KB, 702x423)

222 KB PNG

>>102735351
>obsessed

>>102735388
How are concord sales going?

>>102735296
>and we don't owe them anything either
Have you given them more than free advertising?
>so if we want to say that their move is retarded
Maybe. They want a place in an already saturated market. But still.
>and that they're a bunch of faggots
That's probably true. I won't argue that.
>there's nothing they can do about it
Of course.

I'll just watch.

For me it's Open WebUI. They added Claude-like artifacts recently.

>>102731640
just caught up with ST drama, can someone fork it already? they're 100% trying to go corpo

>>102735402
Baldurs gate 3 :^)

>>102735417
Buy an ad

>>102735422
You do it. I refuse to touch JavaScript.

File: file.png (616 KB, 1183x3308)

616 KB PNG

>>102735441

>>102735422
Better start from scratch, it's the only way to be sure.

>>102735454
you don't need to update it
just fork it and leave it be

>>102735422
>can someone else do the thing??!?!?!

>>102735422
You don't need to update

itt: degenerate pedophiles who are seething because their free application supports tool-calling now (and the main developer said they don't care for low-intelligence non-contributing entitled leach roleplayers)

>>102732373
omg it pochi

>>102735468
>You don't need to update
lol, ST isn't a finished product, new stuff will be needed in the future

3 months back I thought all of /lmg/ retards are fucking morons. Then about 1-2 months ago everyone left and holy shit you newfags are so much more retarded it hurts. And now I accidentally saw >>>/v/691220697 and I have no words for this. I am starting to think I could earn 2 times more money then I am getting now just by setting up some gemma server in some company and fiddling with the sliders and prompt formats a bit.

>>102735473
kek

>>102735454
even though i can code, im a consumer, i dont like using what i build
>>102735457
redot did it so we can.
>>102735468
this is the most retarded arugment i keep seeing. not explaining why

>>102735478
>I am starting to think I could earn 2 times more money then I am getting now just by setting up some gemma server in some company and fiddling with the sliders and prompt formats a bit.
go for it anon, that's how you get rich, by fooling retards

File: 4742ea6d174fc262ab70e0493(...).jpg (48 KB, 600x600)

48 KB JPG

>>102735422
Nah, local RP is dead, there's no point in putting any effort on it.

ITT: Cancer. Children only here to be annoying not discuss anything.
Fuck off.
>our system thinks your post is spam
Nice system, really catching the spam

>>102735500
so you're telling me theres no reason to live is that it?

>>102735477
We don't need new stuff dumbo, we need something lightweight with minimal features. The rest you can code it yourself

File: file.png (2.3 MB, 3280x1545)

2.3 MB PNG

>>102735478
anons, they make fun of us!! :<

File: 1719192858993354.jpg (50 KB, 600x450)

50 KB JPG

>>102735465

File: file.png (578 KB, 700x622)

578 KB PNG

>>102735512
>We
go ahead anon, we'll be following you

>just fork ST
please for fuck sake do not do that please gather around a new codebase so we don't have to tardwrangle tavernslop code please god no stop saying this please

>>102735482
>redot did it so we can.
Godot's shit was more in order than Silly's, not worth forking.
Local autists can conjure a front-end in a month, and silly won't be able to steal features from it.

>>102735519
[screenshot of the /g/ anon who doesn't know how to use git that i don't care enough to find]
That's why the noisy ones are losing their shit.

>>102735478
>I could earn 2 times more money then I am getting now just by setting up some gemma server in some company and fiddling with the sliders and prompt formats a bit.
That's what most of shitty NSFW services are doing look at crushonai, candy AI... milking normalfags is always the best way to get rich fast

>>102735478
And you're reading a somewhat dark side of the web. Now take out a loan, buy a pair of 3090s, set up a front end and an ad campaign and host your 8B. It's basically free money. The only problem is there's already plenty of AI gf sites out there. Now if you can finetune your model on some thirdie language, it'll be extra free money.

>>102735515
Never4get

>>102735515
>pic
Based.

>>102735510
yes, not yet at least, who knows what the future may hold. That's why I still bother to return to this general.

File: costanza.jpg (6 KB, 225x225)

6 KB JPG

>>102735515
The mixture of disappointment and anger at the end is just cherry on top.

>>102735537
Rope tranny

>>102735456
kek

File: sadkek.jpg (36 KB, 478x463)

36 KB JPG

>discord furry melts down and changes direction of their project
>/lmg/ chuds who never contributed any time to the project seethe and call it a backstab
>both sides are easy to troll because they can't stop coping
RIP SillyTavern, ServiceTesnor is the future.

Am I the only one that doesn't give a shit about this? I don't see the problem with just downloading extensions to return the functionality that was removed.

>>102735582
Zen was carefully curating his troll posts in /lmg, while samefagging and claiming it wasn't him. He might have been Petra, except Petra appeared much more chaotic and less thought out.

>>102735677
How well has that worked for keeping Firefox usable?

>ST
Stupid Trannies...

you realize this shit is on the same level as female romance novels, right? thats what youre arguing over. pussy love stories made by a computer.

>>102735703
kek, that's how I'm gonna call ST from now on

>>102735721
I agree. Tool-calling is the future.

File: 20241008_201231.png (28 KB, 770x318)

28 KB PNG

https://x.com/_xjdr/status/1843699665734381596

but... that's the only thing I do for fun after I finish my wageslave shift...

>>102735721
>you realize this shit is on the same level as female romance novels, right?
It is only on the level of female romance novels because it was fed female romance novels. 2 more weeks until a model drops that actually says the raunchy fucked up shit you want it to. Trust the plan.

>>102735675
Backstab is a backstab.
Thank you for giving me another opportunity to associate it with ST brand, troll man.

>>102735751
>nooooo they took away my mindshare! this is a backstab!

>>102735734
Still that 1b model btw

>we're THIS close to AGI and people argue about some shitty frontend that an intern can whip up in 3 days

>>102735734
we are getting really close to something good here ...

File: file.jpg (141 KB, 601x583)

141 KB JPG

>>102735734
Shrek will be our Saviour