🚀 Hugging Face Uploader Tool
A comprehensive backup solution for artificial intelligence assets, designed for creators and developers working with machine learning models. This tool streamlines the process of uploading and managing AI assets to Hugging Face repositories.
FULL PACKAGE WITH PYTHON AND COLAB WILL BE UPDATED HERE: https://github.com/Ktiseos-Nyx/HuggingFace_Backup
Use this Colab Notebook to back up your files: [Open in Colab](https://colab.research.google.com/github/duskfallcrew/HuggingFace_Backup/blob/Huggingface_Backup/HuggingFace_Backup_2024_Colab.ipynb)
Purpose
This tool serves as an automated backup solution for machine learning assets, including model checkpoints, LoRA adaptations, textual embeddings, and other ML-compatible formats. Built upon Nocrypt's notebook and EveryDream2Trainer, it provides a robust framework for asset management within JupyterLab environments.
Core Functionality
The system facilitates secure storage and management of:
* Model Checkpoints
* LoRA Adaptations
* Textual Embeddings
* Machine Learning Assets
* Training Artifacts
Technical Implementation
The tool operates within Jupyter environments, supporting platforms such as:
* Amazon Sagemaker
* Vast.AI
* Runpod
Note: This implementation is not compatible with Google Colab environments.
## Resource Access
*Repository:** [GitHub](https://github.com/duskfallcrew/HuggingFace_Backup)
*Model Updates:** Synchronization with CivitAI upon release
Support Infrastructure
Technical assistance is available through:
* GitHub Issue Tracking
* CivitAI Communication Channels
* [Discord Community](https://discord.gg/5t2kYxt7An)
Professional Network
*Primary Platform:** [End Media](https://www.end-media.org/)
*Asset Repository:** [HuggingFace Space](https://huggingface.co/EarthnDusk)
*Media Presence:** [YouTube Channel](https://www.youtube.com/channel/UCk7MGP7nrJz5awBSP75xmVw)
*Community:** [DeviantArt Collection](https://www.deviantart.com/diffusionai)
*Discussion:** [Subreddit](https://www.reddit.com/r/earthndusk/)
## Development Support
[](https://ko-fi.com/Z8Z8L4EO)
## Strategic Partners
* [Pirate Diffusion](https://www.piratediffusion.com/)
* [Yodayo](https://yodayo.com/)
## Attribution
Built upon foundational work by:
* [EveryDream2 Trainer](https://github.com/victorchall/EveryDream2trainer)
* LINAQRUF
* NOCRYPT [](https://lookup.guru/442099748669751297)
Reference Implementation:
[](https://colab.research.google.com/drive/1wEa-tS10h4LlDykd87TF5zzpXIIQoCmq)
## Development Timeline (CivitAI Edition)
Key Enhancements:
1. Initial framework based on EveryDream2Trainer & Nocrypt's work.
2. Standalone Jupyter Notebook implementation.
3. Standardized file extension support.
4. Enhanced documentation.
5. Optimized user interface.
6. Improved dependency management.
7. Added folder upload capabilities.
8. Colab version updates (for reference).
9. Major code refactor.
The development team welcomes community contributions through the standard pull request protocol.