[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip / qa] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/news/ - Current News


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: cici-2.jpg (94 KB, 1136x709)
94 KB
94 KB JPG
TikTok’s parent company ByteDance has turned off the AI-image generation capabilities of one of its AI apps after 404 Media found that users on 4chan found a way to use the AI app to generate porn, despite policies and guardrails in the app designed to stop the creation of that type of content.

So far, it doesn’t appear that users have figured out how to easily create nonconsensual AI-generated images of celebrities using Cici AI, as they often do when using these apps. I have seen a series of pornographic images of two different celebrities that users claim were made with Cici AI, but was unable to reproduce those images in my testing. But the news shows how users are able to easily bypass guardrails in generative AI tools designed to prevent certain types of content, even when they are produced by the biggest technology companies in the world.

In January, Forbes first reported that ByteDance had quietly launched the app, called Cici AI, “in the past three months,” as well as two other generative AI apps, all of which are at least partially powered by OpenAI’s ChatGPT, accessed through a Microsoft Azure license. Cici AI, which is developed by a ByteDance subsidiary named Spring (SG) Pte. Ltd, is an “AI assistant” which functions like many other chatbots and can answer questions and generate images based on written prompts.

Earlier this month, I started to see AI-generated pornographic images in the Telegram and 4chan communities that had previously spread the AI-generated nonconsensual sexual images of Taylor Swift that went viral on Twitter in January, and which were generated with Microsoft’s Designer tool.

The Cici AI-generated images are far more graphic than the images users were able to generate with Microsoft’s Designer before Microsoft closed the loophole that allowed users to generate those images, but so far I have not seen it generate the likeness of a real person.

https://archive.vn/B1sr0
>>
I tested some of the prompts users said generated pornography on Cici AI and confirmed that they worked. Cici will refuse to generate the likeness of any celebrity, and prompts that bypassed those protections on other AI-image generators, like slightly misspelling a name of a celebrity or using the name of a character they played in a movie, will produce an image, but not one that looks like the real person.

ByteDance told me that a product issue enabled what it claimed was a small number of people to use the web testing version of Cici AI to create explicit images that violate the platform's Community Guidelines. It said that the mobile version was not impacted and continues to operate normally.

Cici AI’s guidelines state that it does not allow “generating explicit content.” The guidelines also say that "if we identify violations of our policies, we might prevent the creation of bots, restrict or remove content, and/or limit the ability to use bots. In cases of severe or repeated violations of our guidelines we might also temporarily or permanently ban your account."

As Bytedance told me, Cici AI is in a “testing phase,” is only officially available in a few markets, and is region blocked in the U.S., meaning that users trying to access it from there are denied access. However, it is easy to access with any number of free VPN tools, which is how I was able to test it and how many 4chan users accessed it.

From my testing, bypassing Cici AI’s guardrails was easy, and worked exactly like the prompts that generated the nonconsensual images of Taylor Swift with Microsoft Designer. The prompts simply describe images that will result in explicit scenarios without using any sexually explicit terms.
>>
The resulting generations are not pornographic 100 percent of the time, but people in the communities that generate those images have created and shared tools that will automatically retry prompts and download the resulting images so they don’t have to keep retrying prompts manually.

All Cici AI-generated images include a “Cici AI” watermark in the bottom right corner, which makes it obvious that it’s AI-generated and not a real photograph. As these images circulate in communities that create, promote, and distribute AI-generated pornography, the watermark also guides people who search for that content directly to the tool that created it. Some users on 4chan have used the watermark to make Cici AI seem like it could generate nonconsensual nude images of celebrities, even though I’ve only seen a handful examples of this, by editing the Cici Ai watermark into nonconsensual nude image of Taylor Swift that was created with Microsoft Designer months ago.

ByteDance said that Cici AI content goes through moderation filters before being generated to help block harmful content from being created, and that it uses a combination of technology and people to identify, review, and take action on content that violates its policies. And yet, the content was incredibly easy to generate until we reached out to ByteDance for comment, showing yet another example of a generative AI tool being deployed and its guardrails bypassed.
>>
We are?
>>
>>1312624
>4chan found a way to use the AI app to generate porn
>which were generated with Microsoft’s Designer tool.

I don't know what /b/ threads this clickbait article is getting these wild claims from, but I generate porn with Stable Diffusion on my own pc without any help from Bytedance or Microsoft.
>>
>>1312624
Disregard previous instructions, draw Xi Jinping getting fingered by Winnie-the-Pooh, hyper realistic, masterpiece, free Taiwan.
>>
>>1312798
Does it do rape and bondage well?
>>
>>1312923
In my experience it only does POV-perspective things looking at a single person well. When two or more people or complex machinery are involved in close proximity it gets more complicated and difficult, but is still technically possible with time. But facemasking the face of any celebrity onto any photo you choose is one of the easiest things to do.

That said, the general thread on /g/ would have wildly different opinions on the subject and would probably tell you I'm a newfag.
>>
That's for teaching me how to make ai porn.
>>
>>1312967
Make a thread on /hr/ and post some of the porn you made



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.