As we progress through 2024, we at Civitai find ourselves at an exciting juncture, marked by significant milestones that underscore our commitment to innovation, creativity, and safety in the generative AI space. This year has been a period of substantial growth and transformation, not just for our platform but for our community as well. We’d like to take this opportunity to provide a detailed update on what we’ve accomplished so far and share our vision for the future.
Expanding Our Platform: Creative Expression Meets Safety for Everyone
Civitai has long been recognized as a vibrant hub for AI enthusiasts, artists, and developers. Our platform has always been about fostering creativity and enabling individuals to push the boundaries of what’s possible with AI. To better serve our diverse community, we are in the process of restructuring the platform into two distinct sections:
Civitai: This section will continue to be a playground for artistic exploration, where users can experiment with AI-driven tools and share their innovative projects with a like-minded community. We believe in the power of creativity to drive technological advancement, and this space will remain dedicated to those who seek to challenge the status quo and explore the limitless potential of AI.
Civitai Green: In recognition of the growing demand for a more controlled area for content engagement, we are launching a new section that will cater to users looking for a more secure and straightforward experience. This space is designed to facilitate commercial activities while ensuring that all interactions are conducted within a safe and respectful framework. Our goal is to provide a platform that supports both creativity and commerce, with robust safeguards in place to protect all participants.
Civitai Green User Experience
Civitai Green is intended to be as seamless an experience for users as possible:
Having or creating an account on Civitai.com will also create an account on Civitai.green and vice versaWhile logged in any content or resources posted on Civitai.Green will also post to Civitai.com, while only safe resource posted to Civitai.com will appear on Civitai.green
Currently Some features of Civitai.com are not available on Civitai.Green until we can guarantee the safety of the content.
Thorn Involvement: Leading the Charge in Ethical AI
As part of our unwavering commitment to safety and ethical AI development, Civitai has taken significant steps to ensure that our platform not only fosters creativity but also protects vulnerable communities. This year, we are proud to have partnered with Thorn, a nonprofit organization dedicated to defending children from sexual abuse. Thorn is at the forefront of developing innovative technology solutions to prevent the spread of child sexual abuse material (CSAM) and other forms of online exploitation.
Our collaboration with Thorn is a pivotal part of our mission to create a safer online space, particularly within the rapidly evolving generative AI industry. By joining forces with Thorn, we are aligning ourselves with other industry leaders to implement robust child safety measures across our platform. This initiative is not just about integrating new technologies but also about setting new standards for ethical AI development.
As part of this initiative, Civitai has committed to:
Implementing Advanced Safeguards: We are enhancing our content moderation tools, including our Semi-Permeable Membranes (SPMs), to better detect and prevent the generation of harmful content, particularly content that could be used to exploit children.
Collaborating on Industry Standards: We worked closely with Thorn and other tech leaders to establish best practices and industry standards that prioritize the safety and well-being of all users, especially children.
Transparency and Accountability: We are committed to regularly updating our community and stakeholders on our progress, ensuring that our efforts are transparent and that we remain accountable to our community and the broader public.
Thorn’s mission aligns perfectly with our core values, and we are honored to contribute to their efforts in making the internet a safer place. This partnership is not just a milestone for Civitai but a critical step in our ongoing journey to ensure that AI technologies are developed and deployed responsibly.
Open Model Initiative: Leading the Way in Ethical AI Development
The generative AI landscape is rapidly evolving, and with it comes the need for more open, accessible, and ethically sound AI models. Civitai is proud to be a key participant in the Open Model Initiative (OMI), a collaborative effort that brings together leading organizations and over 100 AI experts to develop open-source licensed AI models.
The OMI is more than just a technical endeavor; it’s a movement towards democratizing AI. By establishing shared standards, aligned metadata, and interoperable frameworks, we’re working to ensure that the power of AI is not concentrated in the hands of a few but remains accessible to all. This initiative also emphasizes ethical AI development, with a focus on creating models that respect community standards and are adaptable for further fine-tuning by individual creators.
Our involvement in the OMI aligns with Civitai’s mission to foster innovation and inclusivity in the AI space. We believe that by contributing to this initiative, we’re helping to build a future where AI is a tool for everyone, not just the privileged few.
Safety and Moderation: Building a Safe Online Space
While our platform has always been a place for innovation and creativity, we recognize that with great power comes great responsibility. As AI technologies become more pervasive, it is crucial to ensure that they are used in ways that are safe, ethical, and respectful.
This year, we have made significant strides in enhancing the safety and moderation capabilities of our platform. One of the most notable developments is the enhancement of our Semi-Permeable Membranes (SPMs). These advanced filters go beyond traditional content moderation by focusing on concepts rather than just terms. For example, our recent “Celebrity Likeness” update to the SPMs is designed to prevent the misuse of AI by blocking the generation of deep fakes and preserving digital identities.
Since January, we have processed a substantial amount of content, reflecting the vibrant activity and creativity on our platform. Out of the over 200,000 AI models uploaded, our dedicated moderation team proactively removed 5,400 that breached our strict content policies, ensuring that our platform remains a safe and respectful space for all participants. Additionally, we carefully reviewed 19.8 million images, removing 2.1% for violations of our guidelines, a testament to our ongoing vigilance in upholding community standards.
In line with our commitment to safeguarding intellectual property and personal privacy, we have actioned five DMCA requests and responded to 25 requests for the removal of a person’s likeness.
Our collaboration with law enforcement agencies has been crucial in maintaining the integrity of our platform. We have reported 72 accounts for illegal conduct and have cooperated with authorities in responding to 3 requests for information, further reinforcing our commitment to ethical practices and the safety of our community.
This proactive approach to content moderation is part of our broader commitment to creating a safer online space. We understand the potential risks associated with AI and are dedicated to staying ahead of these challenges by continuously improving our moderation tools and protocols.
The Artist Residency Program (AiR): Nurturing Creativity at the Intersection of Art and AI
Creativity has always been at the heart of Civitai’s mission. Our Artist Residency Program (AiR) continues to be a cornerstone of our efforts to explore the creative potential of AI. This year, the AiR program has welcomed several new cohorts of talented artists, each of whom brings a unique perspective to the table.
The AiR program is more than just an opportunity for artists to experiment with AI; it’s a collaborative and exploratory space that invites artists to rethink traditional forms of expression. Each artist in the program is provided with a unique digital studio—a dynamic, living journal where they can document their creative process. These studios are not just virtual workspaces; they are interactive canvases embedded with ideas, work-in-progress pieces, studies, inspirations, and even failed attempts. These elements give the community an intimate view into the evolution of each artist’s work, offering transparency and fostering a deeper connection between the creators and their audience.
To further enrich the program and engage with broader discussions about AI and art, Civitai has launched the "Conversations with Artists" series. This series captures in-depth discussions with the AiR participants, offering insights into their creative processes, the challenges they face, and their thoughts on the evolving relationship between AI and art. These conversations are shared through various channels, including Instagram reels and YouTube, providing the community with an opportunity to hear directly from the artists and engage with their perspectives.
Project Odyssey: Redefining Filmmaking Through AI
Civitai is thrilled to have hosted the first season of Project Odyssey, an AI film competition that has redefined the landscape of filmmaking. Led by the innovative team at Civitai, with the support of industry leaders like ElevenLabs, ThinkDiffusion, Realdreams, Luma Labs, Leonardo AI, and more, Project Odyssey celebrates the convergence of technology and creativity. This initiative has fostered a collaborative spirit of open-sourcing and education, crucial for the growth of the AI creative community.
With over 3000 signups and 1300 submissions, Project Odyssey has been a landmark event in the AI film competition space. The competition concluded with a rigorous judging process, selecting winners who exemplify the extraordinary talent and innovation within the community. Here’s what we accomplished with this competition:
Here’s what we're working towards with this competition:
Foster Opportunities: Provide free education and resources, supporting both AI technologists and traditional filmmakers regardless of their background or experience.
Support Creators: Offer monetary resources to promote sustainable career opportunities and demonstrate how AI can augment creativity.
Democratize Filmmaking: Break down traditional barriers, making the filmmaking process more accessible to everyone, particularly those traditionally underrepresented in the industry.
Spotlight Innovators: Highlight educators and innovators, especially from the open-source community, who are pushing the boundaries of AI in filmmaking.
Mainstream AI Filmmaking: Produced films that combine stunning visuals with compelling narratives, legitimizing AI filmmaking for mainstream audiences.
We invite you to explore the winning films and see firsthand how AI is transforming the creative process.
A Vision for the Future
As we reflect on the first half of 2024, it’s clear that Civitai is at the forefront of some of the most exciting developments in the generative AI space. From expanding our platform to support both creative expression and safe transactions, to leading campaigns like the Open Model Initiative and the AiR program, we are committed to driving innovation in a way that is ethical, inclusive, and forward-thinking.
But this is just the beginning. The rest of 2024 promises to be even more transformative, with new projects, collaborations, and initiatives on the horizon. We are excited to continue this journey with you, our community, and look forward to what we can achieve together.
Thank you for being a part of Civitai. Your support, creativity, and engagement are what make this platform truly special. We are committed to continuously improving and evolving to meet the needs of this community, and we can’t wait to see where the rest of the year takes us.
Stay tuned for more updates and, as always, feel free to reach out with any questions or feedback.