日本語

Hey!

Here is the situation: Cool models are released while only big tech and rich can afford a good machine to run it locally.

There are cloud services, but why many of us want local?

I guess convenience too but also FREEDOM and PRIVACY.

So, here is the REALISTIC SOLUTION: A Cloud service with FREEDOM and better PRIVACY.

Below is tutorial for image/video gen, on the LLM field I recommend NanoGPT/OpenRouter.

Step1. Rent a server on runpod or vastai.

Runpod/vastai is a Cloud GPU service which offer only the machine, and you install what you want so is FREE AS LOCAL.

I advice to search both runpod and vastai and choose the one which suits best your need, but be attent on "Internet Fee" in vastai.

After choosing the machine select a Template, you can choose a Custom Template which will install ComfyUI and models for you, or can choose a minimalistic template then install ComfyUI and models via SSH(direct connection is better, no middle man). If create a installation script and use with SSH, it works on all provider and is easy to choose everything needed so personally I prefer.

For security reason I advice open only 1 port for SSH(only the 22) and use SSH Tunnel to make connections, in most case this is simplest and securest way.

Ok, then Create the Pod/Instance.

Step2. Connect to remote ComfyUI

Make shure ComfyUI and models are installed and ComfyUI are running.

Create a SSH Tunnel, below is an example, where 12345 is remote port, and [email protected] is the remote host, 9001 is your local port to access the remote.

ssh -p 12345 [email protected] -NL 9001:localhost:8188

I advice open a browser on private/secret mode to access remote, as begins with 0 browser data, and ends with 0 data so is a cleaner way to deal with remote. Open localhost:9001 on browser and see if ComfyUI starts.

Step3. ComfyUI-Jumper

Here comes the unique thing in this tutorial.

ComfyUI-Jumper is a custom node to pass string, images, audio via network with other ComfyUI, and if use correctly like the demo on github, your input and generated data are NOT WRITED ON REMOTE SERVER DISK(STORAGE).

This reduce the liklyhood of your data to leak or expose to someone, it requires more effort and aggressive/controversial way to look at your data. Will a company/providers go ahead in exchange with their trust for a simple man just personally enjoying a digital art generation?

Another thing may interest is "Secure cloud" but is more expensive.

Yes, not perfect... but still, a better and realistic way so... enjoy!😉