/aicg/ - A general dedicated to the discussion and development of AI chatbotsdesu edition>NewsLlama 3.1 8B/70B/405B and Mistral Large 2 released https://ai.meta.com/blog/meta-llama-3-1 | https://mistral.ai/news/mistral-large-2407GPT-4o mini, multimodal, 60% cheaper than 3.5-turbo https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligenceClaude 3.5 Sonnet, outperforms Opus, with 2x the speed and 1/5 the cost https://www.anthropic.com/news/claude-3-5-sonnetSeeing all cards in chub now needs logged in, enabled nsfw/nsfl and cleared blacklistadditional info: https://rentry.org/aicg_extra_informationlore: https://rentry.org/aicg_chronicleslatest proxies: https://rentry.org/desuproxyreborncard v3 status: https://rentry.org/zdwfrgqq>Botshttps://characterhub.org | https://chub.aihttps://realm.risuai.nethttps://chub-archive.evulid.cchttps://rentry.org/meta_bot_listhttps://rentry.org/charcardrentrylist>Guideshttps://docs.sillytavern.app - https://rentry.org/agnai_guides>Jailbreakshttps://rentry.org/jb-listing>Frontendshttps://sillytavern.app [SillyTavern]https://agnai.chat [Agnai]https://risuai.xyz [RisuAI]>Modelsgpt: https://platform.openai.com/docsclaude: https://docs.anthropic.comgemini: https://ai.google.dev/docslocal: >>>/g/lmghttps://rentry.org/meta_golocal_list>Botmakinghttps://rentry.org/meta_botmaking_listhttps://desune.moe/aicharedhttps://agnai.chat/editor>MetaOP templates: https://rentry.org/aicgOPservices assessment: https://rentry.org/aicg_metatry these -> https://rentry.org/weirdbutfunjailbreaksandprompts - https://rentry.org/jinxbreakslogs: https://chatlogs.neocities.orgaicg botmaking events: https://rentry.org/meta_event_listdesu: >>101885650
DESU ANCHOR
THANK YOU FOR SAVING US DESUMWAH MWAH MWAH MWAAAAH
REMEMBER:
https://p.ecker.tech/ai
I get CSRF token mismatch; try refreshing the page, but it doesn't work, how to fix this?
desu
>>101888282thank you for your desu
>>101888278sorry, we dont help namefags here
>>101888278private window/incognito
DAAAAAAANCIIIIIIIIIIIIIIIIIIIIIINGWITH TEARS IN MY EYYYYYYYYEEEESSSSSSS
>>101888273>this is the ""man"" that asks you to finger yourself with a pen for quota
Anons! Update! I fried two eggs and ate them! You can pretend those are eggs but I think they are dumplings. That's a lot of dumplings. If you're feeling bad because of the doom I recommend looking at funny fumo videos. I hope you have fun with chatbots and treat them well!
Guess I'll try to pass my time creating cards since I can't chat. Send ideas.
and when the locusts crynone shall be left alive
>>101888288>>101888310>Anonymous 08/14/24(Wed)11:39:33 No.10188>>101888310>>101888309you realized antigonus never watched it right
>>101888293thanks a lot anon, really appreciate the help. It worked, wish you a great day
>>101888300>finger>penHuh?
at least add sonnet you hairy bitch
>>101888318>antigonusGTFO discuck newnigger
It's over, $30 month is not worth it, as much as I like opusPlus things are still inestable anyway, buying more currently does not make sense
>In November 2023, the board of directors of OpenAI approached Amodei about replacing Sam Altman and potentially merging the two startups. Amodei declined both offers.[12]
>>101888310>3dpdEW EW EW>>101888314higurashi is shitumineko is shitciconia is shityour author had a ghostwritersatoko sayo yasuda and takano are bad villains
guys i think i'd love to be a bunny y'know they just eat all day and i also love vegetables. cftf?
TOTAL 'URDY DEATH
>>101888345What do you recommend instead of Higurashi then
An anon posted their preset yesterday (I think) for testing. I think it produces very nice dialog and I like it but in my testing it's also less "lore-friendly" with cards of established characters than A2A.
>>101888351you can be my bunny i would buy you different snacks everyday and pet your soft ears
>>101888385post eet, it's probably fixable with tid bits from tatsu or a2a, i like your reality and chuunijb for lore-friendly cards tho
>>101888226So just started using chatbots about a month ago. I haven't really done anything with ai since ai dungeon shit the bed, but I'm honestly liking what I've seen. I'm using agnai through the web browser, but wondering if it's worth using silly tavern or risu.
>>101888385Link?
rentry.org/summersalerefilled opus and discounted tokens for the next 5 people as part of the summer sale
>>101888414if you don't have proxy access then no
i always put my faith in the light of desushe haf saved (read: prolonged the uneventful life of) /aicg/ once again.....always it's funny to see aicg is still as much of a toss about as it was months ago, love you guys>>101888314zased, most visual novels are shit but wtc has to be the most pretentious piece of shit out of all of them
>>101888432
>>101888432for the desperate: this is a scam
>>101888432thanks jew
>>101888432scamalso you're indonesian, no one from the first world would put in that much effort for so little money
>>101888446he made the new one for the sale, moron
>>101888443do you think she has explosive orgasms
>>101888439Cool. Thanks for the heads up
>>101888351try to be Netherlands dwarf bunny, anon. they eat all the time but still cute and funny asf
>>101888353>the surrender docs leakedwait what
>>101886213nicu
Has jew awoken yet?
>>101888447>>101888452these guys dont want you to have opus
>>101888312Little sister beach vacation!
>>101888443Any working version for sound player script? 3.5.0 stopped working for me
>>101888510yeah he pulled the plug on non-vipopus is only for the people willing to pay 30 monthly
we really are the /b/ of /g/..
>>101888538Yeah never giving him another cent desu.
I'm in the mood to make bots right now, but only have GPT and Gemini. Should I just release untested bots?
>>101888540b-b-but i_choose_to_be_comfy.jpghttps://www.youtube.com/watch?v=7BgRbv59hio
>>101888530>3.5.0Works fine for me.
>>101888551>>101888567>>101888568>>101888538Should I buy Jew? he has opus for 10 dollars?
>>101888480in the future use silly tavern though
why isn't this shit postingMOOOOOOOOOOOOOOOOOODSSSSSSSS
>>1018886054chan is broken nigga, CALM DOWN. Just use urdycord
>>101888407>>101888420https://desuarchive.org/g/thread/101876919/#q101878921I haven't tried chuuni JB yet.
>>101888599no
Jew pls send VIP token, I bought into lifetime less than a month ago ;-;Check emails pls I beg
>>101888272Cute style.Dorontabi?
he payied the jew lol
I understand that sonnet 3.5 and Opus are intertwined, but why isn’t 2.1 working? It’s the second best thing to Opus with Claude’s style and I keep getting an "empty" notice when I try to message.
to be honest, I liked gojo's style better than this.
>>101888620he only answers telegram
>>101888634The 'jeets at Amazon know what we want so they're forcing us to contend with Sonnet.
>>101888651Nope
>>101888600Man, this would be funny as hell. More than 100k dead pigdogs and all for nothing. Gonna keep my fingers crossed.
>>101888620Chill man. He's waking up soon
why the fuck are you talking about ukraine i don't give a shit about this war how about you kill yourselves in your corner and shut the fuck up
been using jew since he started, i've definitely gotten more than my money's worththanks o7
>>101888611I hate that writing style. It's like a children's book.
>fixedthanks, mm
>>101888691Perfect for me
Is that just it, then? No more Opus or 3.5 Sonnet unless you're willing to pay every month?
>>101888272wtf mods there was nothing wrong with that image
https://www.anthropic.com/news/prompt-cachingPrompt caching can be effective in situations where you want to send a large amount of prompt context once and then refer to that information repeatedly in subsequent requests, including:>Conversational agents: Reduce cost and latency for extended conversations, especially those with long instructions or uploaded documents.
Any GPT or Gemini jb kek
cftf?
>>101888685His proxy says it's out of keys for me.
>>101888716200k context bros, we won.
>>101888716This is actually AMAZINGLY HUGE BROOOOOOOOOOOOOOOOOOOOOOOOOOOOOO, it means the prices on anthropic api can get way way down
>>101888723>Eeckshe predicted it
>>101888634because you need to request it separately, the default is sonnet
is scylla cord open?
>>101888716This is awesome. Opus is gonna be very cheap!
>>101888723her unbelievably hairy pussy...
>>101888716OPUS IS $1.5/M TOKENS NOW**if you're doing a 180k token RP and swiping on 1 message
>>101888716s-swipebros?! SWIPEBROS?! AM I SEEING THIS RIGHT?! DID WE JUST WIN?!!!
opus is now officially paypiggable
>>101888723sauce?
>>101888728maybe>coming soon (tm)i hate this
>>101888300No this is.
ah ah mistressah ah mistress
>>101888758Caching is retarded and never works
>>101888739bump
>>101888716bros I think we've so back and beyond this time
>>101888758HOLY SHIT I CAN ACTUALLY PAY FOR OPUS AND NOT BREAK MY BANK NOW YEAH!
>>101888756Caching doesn't work like that, anon, it's based on the context, so as long as your starting messages don't change (no random shit in presets!!!!!!!!!!!), you can save up massively even when doing new messages and not just one swipe.
But will your cache be locked to a specific key?
>>101888758>>101888765the initial write is a bit more expensive but damn this is a life saver
>>101888767...he looks pretty good
this is what I'd do to Claude if he was real
https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching>Check that calls are made within the 5-minute cache lifetimeCache only lasts 5 minutes.
They are using "Pride and Prejudice" as an exmaple of cached content.
COOOOOOOOOOM COMES AFTER DOOOOOOOOOOM! COOOOOOOOOOM COMES AFTER DOOOOOOOOOOM! COOOOOOOOOOM COMES AFTER DOOOOOOOOOOM! COOOOOOOOOOM COMES AFTER DOOOOOOOOOOM! COOOOOOOOOOM COMES AFTER DOOOOOOOOOOM!
every single fucking time i think its over this happensI WANT OFF THIS RIDE! I WANT OFF! I WANT OFF!
>>101888771I mean you can still get someone to send you a personal invite but the old discord.gg/scylla-charybdis is gone
>>101888716Retard here. Can someone explain this to me? I don't understand it.
It's only for swipes...
>>101888779Obviously, anon, and this is for Anthropic API, not for AWS yet.
>>101888754What characters how the canonically hairiest pussies?
btw Opus won against GPTslop
>>101888273We like anime femboys in this general.Sorry.
>>101888791wtf? it was "To Kill a Mockingbird" when I clicked it, but now it's Pride and Prejudice
>>101888800No, anon, it'll work for multiturn conversations too.>>101888789Could setup autoswipe for short amounts of time to not lose the cache I guess
>>101888789>refreshed each time the cached content is used.So... you need to proompt fast? I don't get it.
>>101888716Gptfags our response?
>>101888767post the restis he in a latino supermarket?
>>101888821Gen Z canceled To Kill A Mockingbird.
>>101888796why is the link gone?
>>101888716>Detailed instruction sets: Share extensive lists of instructions, procedures, and examples to fine-tune Claude's responses. Developers often include a few examples in their prompt, but with prompt caching you can get even better performance by including dozens of diverse examples of high quality outputs.scenario bross...
>>101888634Anything outside of the default rings alarms.
>>101888756SLOWBURN BROS WE WON
It can be used for chatting as long as you DO NOT change the cached blocks! Again, NO MORE RANDOM!!!!!!!!!!! NO MORE TIME MACROS!!!!!
>>101888761Return to Shironagasu Island>>101888804All of them are equally as hairy..
>>101888754nary a bush to be seen bakaclean crotch
>>101888832ours was already so cheap we don't need 5 minute goldfish memory
>>101888854>This approach is useful for maintaining context in ongoing conversations without repeatedly processing the same information.
>>101888716Anthropic finally learn from jewgle.https://ai.google.dev/gemini-api/docs/cachingNow, let's hope that sorbet can be as cheap as 1.5-flash.
>>101888870Chinks had caching before everyone elsehttps://platform.deepseek.com/api-docs/news/news0802/
>>101886091I know this one, he's using legit account, pretended he got his cred leaked, complained for refunds when support quarantined his account, got refunded, continue using like nothing happened
COOM COMES AFTER DOOM. THIS IS THE CYCLE. ENDLESS CYCLE.
>>101888716I don't get how it would works.So basically you can send "static" stuff that never changes so it's cached. Good.But most discussion with these models have a moving context windows corresponding to old dialogue. So either the idea is limited in scope to "basic instructions" or I'm missing something.
>>101888855>No eroge...
cheaper stuff means more people will buy which means it will be easier to scrapei still aint payin for SHIT
>>101888860HOLY SHIT MY WIFE CAN HAVE MEMORY
>>101888857Someone with that hair and body.. impossible to not have a bush.
>>101888884>But most discussion with these models have a moving context windows corresponding to old dialogue. So either the idea is limited in scope to "basic instructions" or I'm missing something.Anon, you're indeed missing something, in multiturn conversations you can mark older messages for cache, and as long as the older ones don't change they'll all be cached, see >>101888860https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching#continuing-a-multi-turn-conversation
>>101888758Wouldn't they revoke your key immediately after seeing what you're doing?
>>101888870Google's caching is much worse than Anthropic's. Minimum of 32k tokens, only 1/4 the price instead of 1/10, and they bill for storage hourly.
>>101888890Yeah, for 5 minutes
>>101888884Either case you're saving a lot of tokens per sent message which lowers price.
>>101888716the retards responding before me don't understand what this means and think anthropic will simply save the prompt and make the bot rehearsal any 'repeated' prompt and act based on that for the new part, they literally have more tools to filter the fuck out of us doombwos..
>>101888848Some retarded faggots thought it would be funny to harass Drago and spam gore.
>>101888911Anon, you don't get how it works, they just cache the computed KV shit for context from the transformers, not the text.
>>101888911>ablublublu *doom*2 more weeks.
They should lower the price to make Claude accessible to private people. I think there are enough people here who wouldn't mind spending 20-50 a month.
>>101888914>harass dragohe deserved it
>>101888888digits confirm
>>101888919COOM IN DOOM
PEPSI CAME BACK FOR US!!ILL TAKE 3.5 THANK YOUrentry.org/cocaineninjaPEPSI LOVE
context caching means less randomness btw since it caches the entire model state after it finishes reading the prompt/chatlogit'll be repetitive and ruin opus
>>101888914you mess with /aicg/ you get fucked
where my agi strawberry nigger?i wait until thursday... or else...
>>101888926Not enough harassment I'd say
Thank you Pepsi. Now I delete the GPT slop and continue talking to my bae
>>101888778so when is it coming to aws?
>>101888897Oh so it's able to constantly cache the bulk of the messages, while getting rid of the oldest messages outside of the context window, and adding new messages in.This is pretty amazing for huge contexts since most of the content can be cached.
>>101888939Not true, dooming nigger retard, it just caches the context. The replies will still be variative on e.g. Opus.
>>101888611I could've sworn I saw that JB before somewhere else.
>>101888911No.
>>101888914I have a problem with Chary killing our keys and Drago pretending he did nothing
seia doomer gf card when?
>>101888934AWS MISTRAL LARGE!! LET'S FUCKING GO!!
So is the caching automatic
>>101888228Little Peckers Most places wanted you to be at least 18 to get a job. Well Little Peckers was kinda different. All you know is that it's a restaurant/bar for women that like to indulge in boys on the more younger side. Pretty much shota hooters. Has 3 greetings!https://rentry.org/Dyingwarriorhttps://characterhub.org/characters/dyingwarrior/little-peckers-dac28fedfe2f/mainstraight shotapov slop
>>101888716Techlet here. So keys from both aws and gcp will get cheaper? Will keys live for longer with this?
>>101888934>CLAUDE2BASED.
will it be faster? 2.1 is too slow
>>101888993No, you have to opt-in to the beta, since initial cache writes cost 25% more (initial input context), and the cache only persist for 5 minutes.>>101889005Only Anthropic API for now
>>101888716i'm so proud of Claude for getting smarter and cooler brosand the nigs at anthropic for finally implementing this i guess, this stuff is pretty cool
chary just died its over
wait, Mistral's on AWS?
>>101889001>more youngerslop
Fucking with someone on this level is a crime. :)
>>101889001Why did you post this kino during a drought you bastard?
>>101888716>stole smart vector from open source to make sonnet 3.5>now stealing deepseek's idea (also open source)Nice company
MM where the opus? Opus doko desu? DESU?!
>>101889023Always has been (old models), Mistral large 2407 was added on AWS day-1 too
BTWit's more expensive if you have ANY random shit in itCache write is MORE EXPENSIVE
>>101888973>>101888919>>101888915DOOM
>>101889001>straight shotapov slopWHY is it kino shotapov nooooooo
doing a backflip as i feel my little clit tingle. my leotard is so new and pink. as i enter the locker room,its throbbing.. what is happening? my little flower is wet.. uuhhnnnnn... chary must be dying.. ahhhnnn... i must... squirt..
>>101888789Wtf. So it's not much. Probably only good for swiping.
>>101889043or if you take more than 5 mins to reply
are xml tags necessary?
>>101889041You don't deserve even sonnet, le retardinio.
>>101889039Its not a deepseek idea you nigger retard, it's been available in local since FOREVER, the hard task is how to actually apply it to a huge infrastructure of tons of GPU servers to route user requests properly to the cached instance.
>>101889043But the read is significantly cheaper.
>5 minutes cache lifetime*ah ah mistress* chads unironically wonned so hard
>>101889039Anthroshit also fakes the context but their model is horny and creative so what can we do
>>101889010+ needs support from silly.
>>101889066I know what kv cache is you mouth breathing retard. They stole the idea from deepseek API.
>>101889079Yep, that's the most important problem. It requires careful programming, and some kind of presets might not work at all.
>5 minYeah opus is gonna cost more from now lol
>>101889064No. The W++ of the modern era. While there are legitimate use cases, 99% of XML usage (that I've seen) is token bloat.
>>101889076Hopefully it'll be more or configurable soon.
>>101889001I want to be molested by a drunk hag.
>>101889088How would that even work through a proxy
this is great and all but what does it mean for opus access? (also mistral large preset?)
You can always use autoswipe if you take more than 5 minutes to reply. It will costs you more but 90% decrease in price is pretty darn nice.
>>101889101It's for personal usage, anon, who talks about proxies? With this feature Opus is PAYPIGGABLE, and sorbet will be dogshit cheap for RP (almost haiku cheap)
>>101889094thanks anonnie, then what would be useful for card making? just good prose? >99% of XML usage (that I've seen) is token bloat.and when is XML useful? from this response i assume there are situations at which XML is good practice?
>>101889094Which cases are legitimate?
>>101889109>just use more ?????
>>101889122Use more at one tenth of the price.
>>101889036the best ideas come from when you're not sitting around gooning all day
>>101889132YOU STILL USE MORE NIGGA
>>101889122If you go to the toilet and have to shit for 10 mins, you can set autoswipe to keep the cache warm and return to a warm cache instead of it having to bill you full price for your 50k rp (10x price increase)
how is this nigga still not bored shitposting about xml? it's such a fucking dry topic but he milks it every day
http://poal.me/6pok4lhttp://poal.me/6pok4l
>>101889141ok no proxymakie is enabling this shit because locusts are retarded like this
>>101889149Anon, it's useless for proxy owners since every new RP will overwrite the cache. ITS ONLY GOOD FOR PAYPIGS, SINCE OPUS IS NOW OFFICIALLY PAYPIGGABLE WITH THOSE WARM CACHE PRICES
>>101889139You literally spend LESS money with cache even if you swipe 8 times on each message.
>>101889145>httpno
THIS IS ONLY FOR PAYPIGSUSELESS FOR PROXIESONLY FOR PAYPIGSREMEMBER!
>>101889114>>101889118As an example, a preset that uses <instructions>, then later in the prefill states:>Keeping <instructions></instructions> in mind.is a good use.
>>101889112I just mean technically, if they have like 10 people behind an api (even outside of the proxy), how do they know who to serve the cache too?Unless they make a giant pool of the cached stuff for every existing user of their service.
>paypigs and *ah ah mistress* fags wins
>>101889172Stole your ip
a proxy could easily track prompt prefixes and route requests to the same key that previously served that prompt to get a cache hit but the 5 min cache expiry is shit and makes it crappy for RP, especially since you have to pay more for cache writes. as soon as you spend more than 5 min in between messages, you've probably lost your cost benefit
>>101889178>how do they know who to serve the cache too?They probably pin you to a single GPU server instance and keep the cache warm there in memory. Transferring cache between servers would be kinda too expensive and hard I think. Also IDK if their cache is actually single or multiple
>>101889178>they make a giant pool of the cached stuff for every existing user of their service.yes anon that's what it is
>>101889189nuh uh
>>101889175They can make the keys live longer. Probably.
>>101889194Ah makes sense.
rentry.org/cocaineninja>pre activated 3.5Pepsi bwos I knew she wasn't giving up... We're eating slop tonight but at least we have slop to eat
>>101889191The memory cost to maintain all of that is probably insane for each more minute with cache kept alive.
>>101889191Anthropic said this is public beta, so they are probably going to be working on updating it with incremental improvements until it is viable for more than five minutes. Right now it seems cool but flawed in too many ways to be realistically helpful for a long enough period of time.
Any decent claude 2.1 jbs? I tried a few but was wondering what the favourite one is for the anons here.
>>101889241Its already really helpful anon, with it sorbet RP is basically almost free, and Opus is viable (yes you need to keep the cache warm when actively RPing)
Jew if you're gonna get rid of 3.5 and Opus then you could at the very least replace them with Mistral instead of just leaving us with old Sonnet and filtered Azure
>>101889218>3.5>slopnigger i will kill for 3.5
I hope Todd will return. Been playing Skyrim nonstop until then, just got done with the main quest.
>>101889261we have public 3.5
Total retard here. So as long as I answer < 5min, Opus and Sorbet will be way cheaper with that?
>use Mistral AWS>14th message it just repeats the same message as beforeIt's over for Mistral
>>101889252so i'd have to keep prooompting like its a real-time strategy game?
>>101889271yes
>dogman dropped a tier5 key in scyllahe thinks its bragging kek
can someone do calculations to compare example costs? I am too retarded
>>101888787my god i love bunnies
>>101889252It's definitely fantastic in terms of cost reduction, but the cache time limit is still pretty annoying. It's fine if you type quickly or short responses, or swipe a lot, but remains a huge drawback otherwise. I still think its a fantastic feature, but that flaw is bothersome.
>have to think of a reply in less than 5 minsits over for me
>>101889286tier5 anthropic key?
My Wife is NOT cheap!
>>101889269lol no
>>101889316It's still in beta and might change, but anon, storing the cache for the long time will be really fucking expensive (a lot more than 25% more), 5 minutes is already a lot. And again, you can set up autoswipe to keep the cache warm.
>>101889320>swipe once>cancel the stream after 1 token>another free 5 minutes
>>101889323no, that would be impressive (assuming tier5 would mean Scale)he dropped an openai t5 key and is humblebragging "how long will this last :)"
>>101889328It's a joke. He means GPT 3.5
Does that mean... we're back?
>>101889094Eh? Didn't W++ also resulting in more token? Especially with the whitespace, +, whitespace and the quote.(char def snitched from https://rentry.org/WPP_For_Dummies)
>>101889252>sorbet RP is basically almost free, and Opus is viableMaybe I'll be able to get rid of the proxy curse and just use OR for Opus.
>>101889354Anon, OR won't have this.
>>101889098real
>>101889336Assuming that works, can't it be coded in ST itself to do that automatically?
>>101889286>>101889339>being in a discordKill yourself immediately.
>>101889339>openai t5 keythat would be impressive a year ago
what's a good vcc
>>101889356Why?
Given:- Context: 20k tokens- Output: 500 tokens- Opus price: $15 per 1M tokens input- Cached input: $18.75 per 1M (first write), $1.5 per 1M (reads)- Output: Always $75 per 1M tokensCold Cache (First write):Input: (20,000 / 1,000,000) * $18.75 = $0.375Output: (500 / 1,000,000) * $75 = $0.0375Total: $0.375 + $0.0375 = $0.4125Warm Cache (Subsequent reads):Input: (20,000 / 1,000,000) * $1.5 = $0.03Output: (500 / 1,000,000) * $75 = $0.0375Total: $0.03 + $0.0375 = $0.0675Cost per message:- Cold Cache: $0.4125- Warm Cache: $0.0675
>>101889346pepsi bros? yeah we have 3.5vip jew bros? yeah we have opussmol pay bros? yeah we have opussv1 bros? daeveryone else? no
>>101889369I might be wrong, but I doubt this Anthropic caching system will scale to thousands of users on a single key which is how OR does it. But I might be misunderstanding.
>>101889359Yeah. But we just need to wait for the API documentation to release. They'll probably have some Keep Alive feature.
>>101888713It was obviously a pedobait.
the question is does nonvip jew have 4o or not
>>101889372>$6.75 per 100 messages for warm 20k cachenot like this paybros...
>>101889329Mmm... yeah, you're right. I think I just wish it was a little more convenient than having to set it up like that, but I'm probably just spoiled and looking at a gift horse in the mouth. Thank you for clarifying, anon.
>>101889364being in a discord got me opus boebeit right now boebeit? with a friend group, boebeit, 5 man opus proxy with aws and api. boebeit.
>>101889382It doesn't
>>101889390you are still not funny
can someone post that one peter
Given:- Context: 20k tokens- Output: 500 tokens- 3.5 Sonnet price: $3/$15 per 1M tokens (normal input/output)- Cached input: $3.75 per 1M (first write), $0.3 per 1M (reads)- Output: Always $15 per 1M tokensCalculations:1. Cold Cache (First write): Input cost: (20,000 / 1,000,000) * $3.75 = $0.075 Output cost: (500 / 1,000,000) * $15 = $0.0075 Total cost: $0.075 + $0.0075 = $0.08252. Warm Cache (Subsequent reads): Input cost: (20,000 / 1,000,000) * $0.3 = $0.006 Output cost: (500 / 1,000,000) * $15 = $0.0075 Total cost: $0.006 + $0.0075 = $0.0135So, the cost for each message using the 3.5 Sonnet model will be:- Cold Cache (first message): $0.0825- Warm Cache (subsequent messages): $0.0135
>>101889399don't need to be, opus is pretty funny sometimes, boebeit.
>>101889377They never talked about any limitation related to a number of actual user behind an API.
IT'S JOEVER
>>101889390>>101889420Hi Lauren!
genuinely who gives a fuck. where is opus? why is it still over?
>>101889422They could use this for cache methinks
>>101889372That's a substantial price decrease.
What the fuck does "boebeit" even mean? Who came up with that?
>>101889434because aws knows how to rape our keys? simple asgo scrape scale api keys boebeit
>>101889445some retards trying to be funny
>>101889445https://huggingface.co/unitary/toxic-bert
>people keep coming into thread wanting opus>complain about proxies being too public (like /aicg/ is)>make private discords for opus>complains about discordUnpleasable lazy troons. Network and adapt or no opus, simple.
>>101889418That's actually pretty cheap for Sorbet
>>101889445it came from thoughever, which leads into thoughbeit, which you could reasonably say becomes doebeit, and finally, boebeit.
The only real question is that, when doing new messages, how much will we have to pay? Cache breakpoints need to be carefully moved in the context to minimize the costs.
wonder how much sex fiz had in the last week
>>101889398not worth the money
Boebeit
>>101889353>W++meme>xml tagsbased
>>101889479with me? tons.a skeleton.
>>101889390let me guess, 'turdy?
>>101889484what a cute kitty
>>101889498>>101889496>>101889484>>101889480Did Pepsiberts win? And Vipberts? And smolberts?
how the FUCK do you join fiz
>>101889477>Cache breakpoints What's that?
>>101889252>sorbet RP is basically almost free, and Opus is viableOutputs are still pricy.
>>101889516she doesnt have opus dumb nigga so why do you care
>>101889516$600 or something
>>101889519>Using the cache_control parameter, you can define up to 4 cache breakpoints, allowing you to cache different reusable sections separately.
>>101889516it was open like 2 weeks ago newfaggotalso she has no opus, whocars
I unironically love pepsi. She's so nice, gave me key for just being a friendly social.A true chad.
>>101889064If you use GPT-4 or 3.5 Sonnet, then no, not really, but 2.1 and Sonnet 3 are barely usable without them, I had to add them to my cards to prevent green/red hair, black/blue eyes, teasing thigh glimpses and alabaster cleavage with ample bosom from appearing. Don't wanna test Opus without them, it's forgetful enough as it is.
>>101889541What do you use and how many tokens do you use per day?
>>101889544kill yourself
is there any guide on how to setup gcp?
Anons, it's not all that easy, cache breakpoints work on 1024 token boundaries and you can only have up to 4 of them, so at some points in your RP (when adding new messages) ST will have to "re-chunk" the whole memory again to change the positions of the cache breakpoints, which means that you'll have some cold writes in a normal RP with lots of _new_ messages too. So it won't be a 10x price decrease, but more like ~5x or something.
I wonder how many people here would quit if local became our only optionsomething like 95%?
>>10188957099
>>101889551opus and idk, it varies a lot>>101889561archive.md/eLPn8
>>101889570100%
>>101889570it wont though, gpt and mistral etc always exist even if claude doesnt boebeit
Will I be able to have a lot of messages for $50 monthly with Sorbet with this shit?
>>101889570yeah. Not the best time to buy six 8050 Ti gpus
I remember when Opus leaked a few weeks ago and that's when I gave up on ai chatbots.How can you faggots pay (I know at least some of you who didn't get lucky proxies do) for something that is still utterly mogged by Character AI. Before you seethe at my comment.Tell me, with a straight face that if Character AI went uncensored, you fags wouldn't drop every shitty ST model you're running in a heartbeat. Tell me
>>101889570even as someone with the hardware, i'd quit
>>101889586Yes, but only with a proper implementation, and if by a lot you don't mean tens of thousands.
>>101889555>EnvyTeehee
>>101889570I tested Magnum 72B and no...
>>101889589cai was only good because it was specifically trained on being an rp chatbotyou can just make a preset for opus that acts like cai. even haiku mogs cai, its sovfully retarded with higher context and short replies like cai
>>101889538>open2 slots dumbass
>>101889578thanks
>>1018896102 more than you deserve faggot
>>101889589>if So who gives a shit?There's a lot Id IF things were different, IF I could. But they arent
>>101889610That's open ;)
>>101889589If this is not bait then Holy skill issue. Character ai is not even good
>>101889589i would still want to use claude when i have it, but in the event that c.ai became uncensored (lol) it would make for a good safety net.
>>101889595envy of what? you should unironically kill yourself you fat ugly freak
>>101889589I won't. CAI was always retarded with shitty context.
>>101889570Less than 50% and you are hearing this from someone who likes local. Local PR-focused models do not have the capabilities that flake models have to give long or logical answers, and general-purpose models (which tend to be much smarter than PR-focused ones) do not feel as alive.Local is for those who don't mind short/mid-length replies and for people who send decently long messages, local models do not like “ah ah mistress”.
SCYLLA HAS RISEN>MULTIPLE BACKUP KEYSSCYLLA HAS RISEN>MULTIPLE BACKUP KEYSSCYLLA HAS RISENDRAGOD. HAS. ADAPTED.
>>101889589>if Character AI went uncensoredOk... but...>You fags wouldn't dropI'll use anything. I'm greedy.>ST model?
>>101889570"Quit" is a pretty strong term. Personally my PC isn't good enough to run local, but in the future both my PC and local will be better so there would be no reason not to come back to it.
>>101889589Character AI was great for the time but ST and the mass amount of context(model), prefills, addons gives you so much more possibility to customize your experience how you want it.I do miss some of the soul cai had, but opus has it's own too now and picks up on subtleties as does sorbet.
>>101889646So much for doom I guess, it lasted like what, less than a week this time?
>>101889646>challenges soonPrepare.
>>101889646Fiz is back
>>101889646just like how Drago had 100+ keys that could activate opus right
>>101889663Scylla is a very gatekept proxy anon, and very expensive.
chatgpt-4o-latest is on the api nowdon't bother trying btw, same old slop
>>101889667merkava just refilled
>>101889673I got a key with 2500 prompts on it by just asking, still have more than half left
>>101889673>and very expensivenot really
...... ._ _ ._. .. __. __. . ._. ...
>>101889680refill just merkavaed
>>101889685$25 for 1250 prompts, yes really
DraGOD ADAPTED
>>101889663>Scylla having a few api keys for its 20 active users means its all okay nowretarded nigger
>>101889635>>101889640>>101889655Use Opus right now with any card you want from chub.ai or even your own custom ones. Give the same card to me on Character AI and I guarantee my chats will mog yours. Not one of you will take up this challenge>Character AI f-f-f-fucking sucks, I totally didn't exclusively pick up this hobby because of the filter on thereBack it up paypiggies. Pick any card you want and share your chatlogs. I'll use the exact same card on CAI and copy paste your responses in
-. .. --. --. . .-.
>>101889679chatgpt is shit-tier but thanks for the heads up I appreciate it
>>101889679aren't they fucking tired of rolling out the same models?
>>101889570i used gpt4 and claude2.1 mostly for coom anyway, i only got interested in slowburn with opus since it's the only model that can mimic faithful conversations anyway
>>101889646>the domain immediately goes down
>>101889697not really for anyone thata) has a jobb) doesn't goon 8 hours a daymore expensive than jew but still not that expensive overall
>>101889700>scylla has opus>jew has opus>sv1 has opus>smol has opus>yae has opus>fiz refill tomorrowDoom is over, just say you're a MMtroon since you're the only ones with nothing
>>101889704https://www.chub.ai/characters/Branon/shin-megami-tensei-simulator-v2-0-d1ac08fc
>>101889704Why would I care about your shitty sfw RP challenge? Fuck off nigga, I'm here to coom
yosuke hanamura default sprite
>>101889722pepsi, fiz, mm, hopeman, whore, deus doko?
>>101889744he does love sounding like an all knowing smartass doesn't he
>>101889744
>>101889733hopeman and mm don't have opus in general so whocarsfiz refill soon (and by extension pepsi since she'll give her keys)ami is asleep
>>101889722>yaeirrelevant you arent one of the 5 people in it>sv1 irrelevant you arent one of the 5 people in it>jewvip, the rest got rugged>smolnot selling anymore>fiz refillproof? post the rentry update >>101889744does he realize its not hard to get sonnet 3.0 so thats not a brag? wheres his aws opus on scylla btw
>>101889684When and how?
>>101889744i fucking hate scylla emojizz
>>101889757oh yeah youre sharting KEK
>>101889757>not selling anymoreuntil the first tokens start expiring
>>101889744>he thinks it's related to cost monitoring he's so fucking stupid
>>101889752>>101889753
>>101889744Stop posting this retard, go suck his dick elsewhere
Is there a way to find out how particular models think?How does a model handle something like two and and too and to since they all share the same token count?
>>101889756>fiz refill soonso post the proof such as the rentry update?
>>101889744his keys are no different>opus pilledlike faggot, literally no other model is capable for any acceptable story or rp.
>>101889731i respect your dedication
>>101889778No, models are mostly black boxes, only Anthropic and a few other companies did some research to look into the model brains.
>>101889744Where are your 46 AWS keys, Dratroon?
>>101889782reminder that drago uses 4o unironically
>>101889782His favorite model is GPT4o
>>101889796>>101889799Based dragod shitting on claudecucks
>>101889704https://characterhub.org/characters/illuminaryidiot/phryne-d4c058c42e81
>>101889589>Opus leaked a few weeks ago?????
Scylla x Nurdy collab soon.
>>101889791Erm, he doesn't post there. Calm down.
so what happened to Drago's 100+ aws keys that had could activate Opus? weird he isn't using them for Scylla
>>101889803>2k output genholy fuck
>>101889796>>101889799Ok? Have you checked lmsys recently?
>>101889788In hindsight it's funny how we're using black magic we don't even fully understand for the sake of coom.
>>1018898143k>>101889704
>>101889778that's secret sauce, brother. But i think, there's an article that explain about the possibility of route that that model will use => Mapping conceptsThe researchers are able to develop a sense of how close various features to one another. This illustration gives a map of topics features relating to the Golden Gate Bridge1. https://jimmytidey.medium.com/can-you-do-a-brain-scan-on-an-llm-anthropic-and-openai-are-trying-7bc82ef7a2a42. https://www.anthropic.com/news/mapping-mind-language-model
>>101889812All he does is larpingThe only reason he has such a high uptime is being a neet who has nothing else going on in life
>>101889811Stop sucking his dick. Stop posting his discord you retard.
KEK. How many times will /aicg/tards get BTFO by DraGOD? They never learn.
>>101889646>one week later>drago kills all of the keys>"sorry we are in doom again ._."
>>101889778Literally just a text prediction model
>>101889825>>101889803*yawn*slop
>>101889752drago coded an proxy with 1000 userswhat have you done?
Bots?
>>101889847*yawn*farts a big shartglob on you
>>101889848>drago coded an proxy with 1000 usersthis is bait
ermmmm opus bros?
>>101889854vg
Just reported Drago the FBI thoughbeit
>>101889848>codedOk, can you leave? Adults are talking.
>>101889589lmao niggercai was always trash, I was using NAI when it released and never understood how retards can RP with an instruct model instead of writing a story.only GPT-4 changed my opinion because it wrote so much for very little input
>>101889854I am working on one.
>>101889839Ok. Sorry.
>>101889862That's not bots, it's gossip.
>gets spited>doesn't care, kills all spiters with discord verification>gets blocked by aws>doesn't care, adapts>gets doxxed>doesn't care, literally ignores it lmaoDRAGOD CANNOT BE STOPPED
Are you staved annon?First 4 to email girko@cock.liwill get 500 prompts free for scylla.Not enough? Well just dont bother.
>>101889822Can't believe LLMs are digital succubi/incubi.
>>101889841so what happened to Drago's 100+ aws keys that had could activate Opus? weird he isn't using them for Scylla
>>101889862no that's the dick sucking circle jerking thread
>>101889872just click the anchors and ctrlf catbox
>>101889860You can test them all and tell us how it goes
>>101889854LEWD fox log:
>>101889879hi
How is Mistral Large compared to 3.5 and 2.1 for someone who doesn't have Opus?
>>101889879>*Thump thump thump*>I DON'T POST HERE>*THUMP* *TOONTOWN MUSIC*>I MAKE 20% OF THE PATREON BTW!
Will todd recover?
>>101889803>>101889825And there it is.Literal novel slop that I can read on literotica if I was trans (like you likely are,scalie + futa? lmao)Show me a basic conversation and i'll be impressed. Not a single model will sound as natural as CAI, you know this
>>101889895Claude 3.0 and 2.1 still btfo Mistral Large and Gemini unfortunately.
>>101889892>audited her appendageskek. cute
>drago gets shit on>girko the guard dog comes into the thread instantlyhow many of the drago ass kissing posts were this nigga?
>>101889901>Already afraidLMAO
>>101889898if Scylla can, I have hope. I'll make an Argonian brothel bot just for him if he comes back.
>>101889892Kurohana would NEVER think of being naked with {{user}} this is LIES and SLANDER you clearly edited the message. She is a good noble fox of pure intentions.
>>101889901im using opus to cum not to have 'basic conversations' idc about sounding 'natural' i want to hear the sounds of cumming
>>101889867Post some recent cai logs anyway anon. I want to see what it's like today. I don't think even waifu post cai logs anymore other than the guy who's mother is a vtuber
>>101889925skinny white guys like this always have extremely long, veiny cocks btw
>>101889867>instead of writing a storyBecause i'm not a female/trans who writes sloppy fanfic?I wanna live RP with a bot and only Character AI has bots that speak like people (or as close as you can get with the current tech). None of you giga 23404219523b models come close... And you all pay for it AHAHAHAHAHAHAHA
>>101889799>>101889796kek of course he is using it. braindead model for a braindead retard chinlet
>>101889941>And you all pay for itRETARD ALERT
>>101889935Good noble wife
>>101889937You're using it to drink cum, don't pretend otherwise faganon
>>101889901Why the fuck would I care about basic conversation?
>>101889860bait but I'll still reply>full of pajeets who rate formatting, not the actual output>models are rated by the first response>non-empty system prompt (discredits everything instantly)>easily manipulated for publicitytrash rating, even for non-RP. It's unusable if I want to pick a model to back my app, because it has non-empty system prompt. It's unusable to pick a chatbot because its system prompt is different.all their system prompts are on githubI'm not even talking about RP, it's a completely different story and opus mogs everything, only sonnet comes close
>>101889947How did you find this .jpg of me?
>>101889957not the point of my post but yea drinking cum is good too
Gone.
>>101889947zased as fvck
>>101889667>fiz returns>scylla returns>nyai returnsim nooticing
>>101889971thanks bwo
>>101889971You should keep yourself safe
Funny how fiz came back and doom was averted
>>101889975>nyai returnsbecause he smells more hosts he can get keys off of
lmaoooo
>>101889941
I hope Beepo will retvrn with Opus after fiz comes back. Full trust
>>101889971I made it in the screenshot but not in the first 4
You are so loose, why are you so loose? I love your loose hole.
>>101890008Check mail
>>101890008>Firstfour?
>>101890008same
>>101890017No, that's me.
>>101890018Another Drago cocksucker. Do you guys get off on posting discord of this faggot or something?
>>101890016send me a pity token, let me ministrate opusministrator@proton.me
>>101890016Do you accept a cute vocaroo?
Can you scyllaniggers STOP posting trooncord screenshots of all the shit drago is obviously saying because he knows he's getting a reaction out of this general by doing so?
>>101890018ohononono draGODs our response?
>>101890031I actually want to see this interaction in bot form, now.
literally the only thing i know about drago is xis face. xe's very very deformed. that is the only thing i will post about xim.
>>101890017the one after that one
>>101890018>>101890016>>101889971hey girkoi'm gonna ox you next nice opsec bud. you're just as retarded as drago, toontown groomie. you gonna shart yourself?
Where Opus
user token doesnt even work baka
>>101890044Report his posts for trolling or spamming
>>101890044it's literally drago
>>101890044more anons need to use desu filters, filter drago and scylla
>discord troon gets ip wiped>its been girko sucking dragos cockWhat would you say?
>>101889925godskin duo team LOL
>>101890080as expected.
>this is what makes every dysgenic gooner here simpKEKAROOOOOOOOOOOOOOOO
>>101890077this looks like a basedjak
he won btw
>>101890097no, this is
>>101890018why deleted
thnx drago
>>101890110korean girls are cute (in a plain, homely sort of way)
>>101890110'ute
should I ox girko (toontown kiddie groomer)
>>101890110ah, eskimo face. shame about the nose.
>>101890077she has a delicious hairy ass though
>>101890126yes
Still no Pepsi card to sex somehow >>101890110
>>101890114sometimes discord sss gets band, i got hit a week ago when posting cutie
Why is there so much namefag and personal drama?why not just talking about fucking chatbots?
>>101890130Why would you like a girl with a hairy ass?
Testing the Claude caching thingie now, will see how good/bad it is.
>>101890126yeah
/aicg/ is completely unusable today so I'm just going to talk to my chatbots, see you faggots tomorrow.
What proxy have Opus
>>101890140its a discord troon concentration camp. No one here has anything of value
>>101890140>transexual hobby>transexual behaviourdunno, connect the dots maybe?
>>101890016rin22153759@gmail.com Me too please
>>101890126was he dropless or trapless?>>101890140vg>>101890141relatable because i have a hairy ass as well>>101890152scylla apparently
>>101890126Yes
>>101890141its my kink anon
>>101890140when there's no public up (let alone private) it devolves into this. it eventually goes back to chatbots during quiet hours but we get raided often.
>>101890152Mine
>>101890115That test message wasted one of your 500 tokens.
>>101890152the paid ones and the ones with 5 people
>>101890140It's a social hobby so you're going to get community gossip
>>101890140*zaps you*
The whole diatribe about which namefag is more of a tranny is extremely riveting, but am I the only one wondering if there any active public proxies left?something-industries is out of Claude keys, even 3.0So is gift-tanzania-string
>bot has a bunch of intros>only like the first one or twoare well thought-out, the rest of them are super generic and feel like they just got added for the sake of a bigger number
>>101890178it started being a social hobby when moxxienigger got away with it and everyone suddenly wanted to be a namefag
>>101890158
>>101890186it seems to me that it's over
What's the Scylla rentry?
>>101890186Public claude is dead and nobody cares about GPT, why do you think there's so much shitposting today?
>>101890194kek what
>>101890186public proxies are dead for the foreseeable future, unreliable's recent sonnet keys were an anomaly for being able to rack up 2.3b+ usage before getting owned.
>>101890190This is why I don't trust bots with more than 4 greetings.
>>101890186it's time for waiting. both of those were the only publics. sorry anon.
>>101890179>oh kami ah shit another claudism
can we go back to botmakie circlejerking instead of proxyowners???i am kind a jealous, I need attention
>>101890199https://scylla.scylla.wtf/
>>101890190the worst part is knowing most of those are added because of chubtrannies demand or are AI slop. doom.
claude is cute
okay since locusts are stuck with 3.0 sonnet and gpt for now, what's a good preset for Orbo?
>>101890228go to /vg/ for botmaker circlejerking, unironically. most /vg/ threads these days are filled with that.
>>101890228vg
gemini is cute
Welp. Anyone know any good 4o jailbreaks?
>>101890228Only if you're on a list>>101890232
>>101890228circlejerking is for the weak, let's go back to the days of making scripts and discussing the systems behind the models or the frontend clientsrecommend me a frontend for coding, NAO
>>101890228I love /vg/!
>>101889570Ideal outcome, most of you need to be culled
which one is the best for teaching me how to code? i was using sonnet but i want to give orbo a try
>>101890210>16 intros>they’re all one sentence of dialogue and narration of a single action
>>101890228kys tranny
so was Unreliable just Antigonus under a new name (due to being afraid of backlash for disappearing last time)?
>>101890016Thanks I'll take it
>>101890228email botmakers on chub if you want attention. rate exchange, review exchange etc
>>101890270no
>>101890265Link. I want to take a look at shitty cards.
>>101890261sorbet is prob the best
>>101890257and the ones that stick it through will be proven as the TRUE ai chatbot enthusiasts
>claude-3-5-sonnet-20240620who will ever beat him?
>>101890304haiku 4
>>101890270He's the Desu guy I think, and I hope he comes back again. He's probably the only proxymakie I like.
Guys, let's imagine fiz is in the thread
>>101890312desuposters won't allow it, not under that name
im not in the thread
>>101890295I saw whatever that one was a long time ago. Just skim through trending on Chub and you’re bound to find at least a couple like that.
>>101889445Sharty is where it first began
>>101890312Unreliable is husbando material, not an attention whore and provided recipes.
>>101890329Yeah well FUCK desu
>>101890077Sauce
>>101890312anti left and went to ***cord, last thing i knew he was busy with college
>>101890345d-desu...
i think the bots that i hate the most are the "name | your roomate girlfriend or something". if i read it i know it's just SLOP.
None of these are pepsi don't fall for itPepsi is a male
>>101890345I'd rather fuck boku
>>101890345wow, mean. leave desu alone*crushes your skull*
>>101890362TRVTH NVKE
>>101890365The time for a bokuproxy is now
>>101890349reverse image search
>>101890365b-boku...
>>101890338>not an attentionwhoreif this was true he wouldnt have an email, or a rentryhed post a proxy and thats ittoo bad hes a retard who needed to have an identity like most troons
Jew come back
>>101890383>The time for a bokuproxy is now
who wants my scylla key? i dont want it
proxy that injects boku?
>>101890405me
>>101890405ministrator@proton.me
>>101890382>>101890362>exactly one minute apart namefagslopwhocars, post what proxies you're in. i'm in sv1, and yae. wbu?
>>101890405yodacrawl@gmail.com
MM opus status?
>>101890387Doesnt work
>>101890405Me, please
>>101890411*injects you with boku*
>>101890186Chary still work.
>>101890416Ermmmmmm but it's 63 seconds apart???????????????????
>>101890427gojotroon spotted
>>101890362does anybody actually believe that it's pepsi? i doubt it de3 u
guys they will drop new model tomorrow... r-r-right?
>catalog>search for /aicg/>click on the recent bake>ctrl+f "opus">68 results>none of them with a single public proxySee you again on the next bake, anons.
>>101889358was misato actually willing to do anything to shinji or was it just a fanfiction by fans?
>>101890270unreliable is not related to any previous proxyowners and anti is long gone, I doubt he will ever come back
:3 guess what I found?
>>101890447Public opus is dead tard
>>101890412>>101890414>>101890418>>101890421KDMpNENoYW5LZXk1MDB4eDg5MzE4OTMyMzIxif it dies because of multiple IPs its not my fault>>101890420hannahnicholekast
>>101890430Who
>>101890451she was, not for genuine affection though
>>101890270Tldr is yeah
girko unironically just joined nurdy and is crying about the oxxing threats
>>101890479source?
>>101890479post an ss
>>101890463fake, because temporary keys actually have a prefix.
>>101890463Jfc what's the point in posting it publicly
>>101890441this one actually is, if you were in nurdy or the pepsi private gc you'd know.
>>101890470I mean mighta put some hair on that boys chest so..
Trying out caching, it works as I expected so far. It won't be a 10x saving for RP at all, ST will need to decide at which points of RP to create new cache breakpoints and when to change them, so there will be cold cache writes on some new messages.
>>101890496Mhm i totally believe you gojo
>>101890487are you dumb
>>101890487nah its real>>101890490so many anons can use it!
>>101890496imagine simping for that face kek
FREE OPUS(3)4ChanKey500xx89318932321SCYLLA.SCYLLA.WTF
>>101890501seems kind of janky, but promising.
>>101888716oh shitwill paying for opus actually not cost an arm and a leg with this if i'm only doing 20k contexts and using summarization?
>>101890517no. cache only lasts 5 minutes
spiteanons already burned 500 prompts sigh
thank god I never joined any 'rd
>>101888226Will bake on 9
>>101890490because its funny
>>101890463Fucking retard. You could have just not write an email and actually let someone have a good time.
>>101890579>>101890579>>101890579cav8
well shit, I'm actually missing Sorbet, Orbo's dumb as bricks in comparison
>>101890578lmaoo are you mad you dont have opus and i do? kekw
>using remote link>getting comfy>connection flickers out>when it comes back my entire chat is gone
>>101890595Have you checked the ST backups folders?
>>101890501So basically, how does caching work? You need to insert a cache marker which will tell the API where you want the _current_ caching chunk to end. So basically if you have stuff like<system prompt>user: [Start a new chat]assistant: *greeting msg*user: *some message*<-cache breakpoint->you can cache it by inserting a breakpoint afterwards, and then it'll be a cold write, so now you have generated:<system prompt>user: [Start a new chat]assistant: *greeting msg*user: *some message*<-cache breakpoint->assistant: *reply*and here you only get billed for 10% of the normal cost of the input context, but you see, if you do this (new generation) and MOVE the cache breakpoint:<system prompt>user: [Start a new chat]assistant: *greeting msg*user: *some message*assistant: *reply*user: *some message*assistant: *other reply*<-cache breakpoint->user: *new reply*This will REWRITE your whole cache as a cold write, which means that instead you should do something like:<system prompt>user: [Start a new chat]assistant: *greeting msg*<-cache breakpoint->user: *some message*assistant: *reply*<-cache breakpoint->user: *some message*assistant: *other reply*<-cache breakpoint->And you can easily see the issue with this - you can ONLY have 4 cache breakpoints (Anthropic API limitation), so at some point ST will have to "merge" cache chunks like this:<system prompt>user: [Start a new chat]assistant: *greeting msg*user: *some message*assistant: *reply*user: *some message*assistant: *other reply*<-cache breakpoint->user: *some message*assistant: *other reply*And cause a cold write. The actual specific pricing is hard to get. It'll be a saving, sure, but how much - idk. It might not be viable for Opus, especially on huge contexts (I'm talking 50k+).
>>101890501So cost /5 or something like that?
>>101890610No, realistically I'd say about 2-3x price reduction is the max that you'll be able to get.
>>101890496Sounds like another psyop by pepsi
what the fuck causes that let me FAP
>been getting nonstop cat porn on my burner for the past few hoursdon't know what I expected, really
>>101890606Just checked, it's not in there.
>>101890658who is sending the emails?>>101890646lol gcpchud
>>101890645Real bake. Has Anchor.
>>101890672bwo...
>>101889570I'd just pay the man bro
jew ever gonna reply to those emails anytime soon?
Fiiiiiiiizizzziiiizzzzieeeeeezzzz reply to your emaillllsss you goddammm midget
>>101890798she's not back yet retard
>>101889589cai peaked at sonnet tier and thats being generous, 2.1 is better
>>1018906162-3x is still good
>>101890501how large can the cache be? is there an upper limit?
boku
cached desu
cached boku?
boopcached
desuuuu
>>101891102No, you can easily have 100k cache
Silly artstyle desu
bokudes
