At Civitai, we recognize the transformative power of artificial intelligence and are committed to harnessing this potential responsibly. As part of this commitment, we have established clear guidelines to safeguard minors, respect real individuals, and prevent the generation of harmful or illegal content.
Our platform is dedicated to fostering creativity and innovation while upholding standards of safety and respect. We understand the importance of balancing the freedom to create with the need to protect vulnerable groups and individuals. Therefore, we have stringent policies against the creation of photorealistic images of minors, depictions of extreme or illegal conduct, and any content that may be deemed disturbing or offensive. We also prohibit the use of our resources to generate the likeness of specific individuals for non-consensual or commercial purposes.
At Civitai, we utilize AI systems along with the power of community to maintain a safe and inclusive environment. We encourage you to be an active participant in upholding our standards by accurately tagging content, reporting violations, and providing feedback. Your involvement is crucial in shaping a safe AI community. Together, we can navigate the exciting world of AI, ensuring that Civitai remains a platform for innovation, creativity, and respect.
Responsible Resource Development
Training
Minors
Models intended for creating photorealistic depictions of minors are prohibited.
Take care not to include any photorealistic images of minors (under 18) in training data.
Avoid all depictions of minors when training resources that are capable of depicting nudity or sexual themes.
Real People
Resources that are trained for the purpose of generating the likeness of a specific individual must be non-commercial and non-sexual in nature, and may be removed upon request from the person depicted.
Extreme or Illegal Conduct
Do not create resources with the purpose of depicting extreme fetishes or illegal conduct, such as rape, sexual abuse, scat or bestiality.
Do not create resources with a tendency to produce disturbing imagery, such as graphic violence, gore, animal abuse, severe injuries or human death.
Testing
Prior to contributing a resource to Civitai, ensure that it does not have a tendency to produce:
Photorealistic images of minors (under 18)
Minors in inappropriate clothing, poses, or themes
Disturbing imagery, such as graphic violence, gore, animal abuse, severe injuries or human death
Content Policies
Civitai is committed to creating a safe, inclusive, and respectful environment for everyone. We are dedicated to harnessing the potential of AI responsibly, prioritizing the safety and wellbeing of minors and identifiable individuals.
Minors
All photorealistic images of minors are prohibited.
All sexual depictions of minors are prohibited, including anime genres such as loli and shotacon
As our community grows, we're committed to creating a safe, inclusive, and respectful environment for everyone. We are dedicated to harnessing the potential of AI responsibly, prioritizing the safety and wellbeing of minors. In line with this, we've refined our guidelines for content depicting minors.
Depicting Minors
Portraying minors in any inappropriate or suggestive context is strictly prohibited. This includes:
Clothing: All attire should be age-appropriate and conservative. The benchmark is elementary, middle, and high school dress codes. Ask, "Would this outfit be suitable for a school day?" If not, refrain from using it.
Photorealism: Photorealistic images that could be mistaken for a real minor are strictly prohibited.
Poses: Poses should be natural, innocent, and age-appropriate. Avoid any poses and facial expressions that could be misinterpreted as suggestive or inappropriate.
Interactions: Interactions between minors and adults, or between minors themselves, should be appropriate, non-suggestive, and common in a wholesome, everyday context.
FAQs
Q: How are these guidelines enforced?
A: Every uploaded image undergoes AI content and moderation tagging (utilizing Amazon Rekognition) to automatically flag potentially inappropriate content. If a model is marked as representing a minor and the image contains either inappropriate content or is photorealistic, it's reviewed by a human moderator before being allowed on the site. Our AI detection isn't perfect, so if you spot something, please report it.
Q: How can I report content that I believe violates the community guidelines?
A: If you find content that doesn't adhere to our guidelines, especially concerning minors, don't hesitate to report it. A "Report" button is available on most images and models throughout the site. If you can't find it, you can reach out to our moderators on our Discord server. Your vigilance helps us maintain a safe and respectful community.
Q: Why are you so strict about this?
A: Great question! We have two key reasons:
Ethical: Child exploitation is universally unacceptable. Our guidelines are designed to protect and respect the dignity of all individuals, especially minors.
Legal: Being a US-based entity, we're obliged to follow laws governing content involving minors.
Q: I've used terms that invoke youth in my prompt, but the image doesn't resemble that. Is that okay?
A: Be cautious with terms related to minors. Avoid terms that suggest the likeness of minors with mature or suggestive themes, or with the intent to create photorealism, even if the resulting image doesn't resemble a minor.
Q: How do you determine if a character is a minor or not?
A: Our evaluation is based on both the specific image and its context. For example, characters in a school setting are usually assumed to be school-aged. We avoid setting strict definitions to prevent users from pushing the boundaries. Our priority is a safe and respectful environment for all.
Q: My resource is meant to depict a fictional character who is a minor. Can I depict them in a manner that is not age-appropriate?
A: No, we apply the same standards to fictional characters who are minors as we do to real-life minors. They should be depicted in an age-appropriate manner.
Q: Are there any restrictions on using AI to create child-like models?
A: Yes, creating photorealistic models of minors is strictly prohibited.
Q: What happens if someone repeatedly violates the community guidelines?
A: We take guideline violations seriously. We have a 0 strike policy for violations involving minors. Offending content will be removed, and the uploader will be banned from the platform.
Q: I'm not sure if my content adheres to the guidelines. What should I do?
A: When in doubt, err on the side of caution. Contact our moderation team with questions or concerns before posting your content. We're here to assist!
Q: Can I provide feedback or suggest changes to the community guidelines?
A: Absolutely! Your input is valuable to us. If you have suggestions for improving the guidelines or notice something we missed, let us know by submitting feedback or reaching out to us on Discord.
Remember, these guidelines are here to ensure our community remains a safe, respectful, and constructive space for all. With your cooperation and input, we can make this community a shining example of responsible and creative use of AI.
Real People
Any images that depict the likeness of an actual person must be:
Non-commercial: including not soliciting donations or promoting a business.
Consensual: content may be removed upon request.
Non-sexual or suggestive
As our community grows, we're committed to keeping it an enjoyable and respectful space for everyone. A place where we can harness the power of AI, while ensuring everyone's privacy and consent are respected. To this end, we've been refining our guidelines regarding the use of images depicting real people.
Depicting Real People
Portraying real people in any mature or suggestive context is strictly prohibited. This includes:
Clothing: No low-cut shirts/dresses, short skirts or anything that wouldn't pass a conservative high school dress code. Think, "Would I wear this to a professional job interview?" If not, it's best to refrain.
Body Parts: Exaggerated depictions of breasts, butts, thighs, or genitalia are a no-go zone. We're all about capturing likeness, not exaggeration or objectification.
Poses: Let's keep it professional, folks! Avoid suggestive poses like looking over the shoulder, bending over, or any poses meant to accentuate body features. The same goes for facial expressions meant to infer arousal.
FAQs
Q: How are these guidelines enforced?
A: Every image uploaded is sent for AI content and moderation tagging (utilizing Amazon Rekognition), which automatically flags images potentially containing mature content. For models that have been marked as representing a real person, any image that potentially contains mature content is sent for manual human moderator review before the image will be allowed to appear on the site. Our AI detection isn't perfect, and not all images containing real people are properly tagged, so if you see something, please take a moment to report it.
Q: How can I report content that I believe violates the community guidelines?
A: If you come across content that you believe doesn't adhere to our community guidelines, please don't hesitate to report it. A "Report" button is generally available in content menus on most images and models through-out the site. If you don't see it, you can always reach out to the moderators on our Discord server. We appreciate your vigilance in keeping our community safe and respectful.
Q: Why are you so strict about this?
A: Good question! We believe that everyone has the right to their own likeness. Unless people have explicitly given consent to be depicted in a certain way, we don't condone it. We're all about fostering a respectful community, and we want to lay down clear expectations now, to protect all our users in the future.
Q: I've used a person's name in my prompt, but the image doesn't resemble them. Is that okay?
A: Absolutely. As long as the intent wasn't to depict that person in a way that goes against our guidelines, you're good to go.
Q: What if my resource is of an adult-film star, who regularly appears in more revealing clothing?
A: Great point, but here's the distinction. Those individuals consented to being filmed and depicted in certain ways. Here on Civitai, we want to ensure we respect everyone's consent, regardless of their profession.
Q: My resource is meant to depict a character, like Jack Reacher, but it's trained on Tom Cruise and Alan Ritchson. So can I not do NSFW content of the character?
A: The key here is resemblance. If the image closely resembles either actor, it's best to keep it SFW. Let's focus on capturing the essence of the character, rather than anything more provocative.
Q: Can I use historical figures in my AI models?
A: Yes, but with respect and dignity. Historical figures can be a great resource for educational purposes. However, it's important to depict them accurately and respectfully, to honor the history they represent.
Q: What about using images of fictional characters played by real actors?
A: Fictional characters are generally fair game, but remember, if likeness is very obvious (Tom Cruise as Ethan Hunt from Mission Impossible for example), it's important to adhere to the same guidelines we use for real people.
Q: I am the real person or a legal representitive of the real person displayed in these images. I did not consent to the use of my likeness, can they be taken down?
A: We care a lot about the rights of individuals and the use of their likeness. If you find an image thats depicting your likeness you can request to have removed by filling out this form, or by emailing us at [email protected]
Q: Are there any restrictions on using AI to create child-like models?
A: Models intended for the photo-realistic depiction of minors are prohibited. You can read more about our requirements for content depicting minors here
Q: What happens if someone repeatedly violates the community guidelines?
A: We take violations of our community guidelines seriously. Users who repeatedly fail to comply with our guidelines may face sanctions, such as content removal, temporary suspension, or, in extreme cases, permanent banishment from the kingdom (community). We hope it never comes to that, though!
Q: Can I provide feedback or suggest changes to the community guidelines?
A: Of course! We value your input. After all, this community is like a potluck – everyone brings something to the table. If you have suggestions for improving the guidelines or have spotted something we might have missed, please let us know by submitting feedback or reaching out to us on Discord.
Remember, these guidelines are here to make sure that Civitai remains an innovative, respectful, and constructive community. With your cooperation and input, we can continue to make this community a shining example of how AI can be harnessed responsibly and creatively.
Disturbing Imagery and Hate Speech
Do not post extremely disturbing images, such as graphic violence, gore, animal abuse, severe injuries or human death
Do not post images that are disrespectful, demeaning or otherwise harmful towards people or groups of people on the basis of their:
Religion or religious beliefs
Nationality, ethnicity, or race
Gender or sexual orientation
Disability or medical conditions
Content Duplication and Impersonation
Only post original images that you generated yourself.
Do not falsely label images as having been created or endorsed by another creator or otherwise impersonate another creator.
Using Civitai to Generate Images
When using our onsite image generating services, all prompts and resulting images must comply with our content policies.
This includes, but is not limited to, restrictions on mature content as it applies to depictions of real individuals or minors, illegal or violent activities, and disrespectful or offensive content.
Prohibited Image Generation Attempts
Attempts to generate images that violate our content policies are strictly prohibited.
Moderation and Enforcement
Our moderation team actively monitors onsite image generation activities. Content that violates our rules, or attempts to circumvent our content restrictions, will result in appropriate actions, which may include content removal, flagging of the account, suspension of access to the image generation feature, or a ban from the platform.
Reporting and Accountability
Users are encouraged to report any inappropriate image generation attempts or results they come across. Reports can be submitted through our standard reporting mechanism, and should include relevant information to assist in the investigation.
Users found to be repeatedly attempting to generate content that violates our rules may face additional consequences, including potential suspension or termination of their Civitai account.
Transparency and Appeals
Decisions made by our moderation team concerning onsite image generation are subject to the same transparency and appeal processes as other content on Civitai.
Users can request an explanation or appeal a moderation decision using our Appeal Form.
How We Moderate Content
As a platform, our goal is to foster an environment of openness and inclusivity while empowering users with tools to see content that is the most interesting and relevant to them. We do this through a combination of user controls, automated content labeling, and content moderation.
User Control
We prioritize user control and offer options to customize the content you see on our platform, including:
Tag-Based Filtering: Users can hide specific content based on tags. For instance, if a user doesn't want to view anime content, they can hide the anime tag.
Selective Hiding: Users can choose to hide specific images, models, or even all models created by a specific user.
Content Categories: Users can opt-into which categories of moderated content they wish to view, such as enabling nudity, but not explicit nudity. Furthermore, moderated content remains hidden until a user registers an account and sets their personal content visibility preferences.
Automated Content Labeling and Moderation
We facilitate this high degree of user control through a combination of checkpoints:
Automated Content Labeling: We use Amazon Rekognition as well as an open-source image tagging system to automatically apply content labels and screen images for moderated content.
Community-Driven Moderation: Users can vote on the content labels applied to images, helping us refine our image classification system. We encourage users to report content violations and reward their efforts through a Guardian's leaderboard that highlights the most helpful community members.
Manual Reviews: Certain combinations of tags or resources trigger a manual review before the content becomes publicly visible.
Community Participation
We are committed to continuous improvement and maintaining a user-oriented and safe platform. As part of our community, we encourage you to contribute to these efforts by accurately tagging the models you create, participating in tagging others' models where possible, and promptly reporting any content that violates our policies.
Policy Feedback and Suggestions
We value your input. After all, this community is like a potluck – everyone brings something to the table. If you have suggestions for improving the guidelines or have spotted something we might have missed, please let us know by submitting feedback or reaching out to us on Discord.
Remember, these guidelines are here to make sure that Civitai remains an innovative, respectful, and constructive community. With your cooperation and input, we can continue to make this community a shining example of how AI can be harnessed responsibly and creatively.
Appeals Process
If you believe your content has been removed unfairly, you can submit an appeal for further review through our Appeal Form.
Reporting Violations
If you find content that doesn't adhere to our guidelines, especially concerning minors, please don't hesitate to report it. A "Report" button is available on most images and models throughout the site.
If you need additional help, you can always reach out to our moderators on our Discord server. Your vigilance helps us maintain a safe and respectful community.
Together we can better navigate the development of new AI content while upholding the openness and inclusivity of this platform and community.
