CLOUDY COLLABORATIONS
Sovereign Notebook · Python in Browser · Zero APIs
Python ReadySOVEREIGN 1
5:07:54 PM
Sovereign Engine Bridge
Zero API credits · Local execution onlyNotebook UIDispatcher
ComfyUI :8188Blender :8765
E:\CLOUDY_DRIVE\exports\ComfyUI OfflineBlender RPC Offline
sovereign-terminal1 lines
5:07:52 PMComfyUI offline — start: python main.py --listen 127.0.0.1 --port 8188
>
ComfyUI: python main.py --listen 127.0.0.1 --port 8188
Blender: blender --background --python server_rpc.py (WS :8765)
Auto-poll every 15s · Job completion tracked via /history · Zero API credits
Sovereign Pipeline Orchestrator
AccuRig · Lip-Sync · 8-Angle PNG · Daemon04_INPUT_WATCHER\ComfyUI :8188AccuRig :8189LipSync :8190Blender :876505_OUTPUT_STREAM\
Mesh Gen
●
Auto-Rig
○
Retarget
○
Lip-Sync
○
PNG Render
○
Export
○
Daemon Offline
1. Input Mesh (FBX/OBJ/GLB)
2. Audio (WAV/MP3) — Optional
8-Angle Render Output Preview
front
FL45
left
BL45
back
BR45
right
FR45
sovereign-pipeline-terminalRig:1 | PNG:1 | Lip:1 | Daemon:1
5:07:52 PMRigging engine offline — start: accurig-cli --serve --port 8189
5:07:52 PMBlender render service offline — start: blender --background --python render_server.py
5:07:52 PMLip-sync engine offline — start: python viseme_server.py --port 8190
5:07:52 PMDaemon offline — start: python pipeline_daemon.py --port 8191
Master LauncherE:\CLOUDY_DRIVE\LAUNCH_CLOUDY_CORE.bat
01_ENGINES
ComfyUI + Blender + RVC
:8188/:8765
02_SCRIPTS_CMD
Watchdog Daemon
:8191
03_BASE44_CMS
FastAPI Bridge
:8000
04_INPUT_WATCHER
Drop Zone
folder
05_OUTPUT_STREAM
Render Bins
folder
Master: E:\CLOUDY_DRIVE\LAUNCH_CLOUDY_CORE.bat (one-click bootloader)
Watchdog: python 02_SCRIPTS_CMD\watch_inputs.py (polls 04_INPUT_WATCHER\)
Blender RPC: blender --background --python 01_ENGINES\blender_rpc.py (ws://:8765)
FastAPI: python 03_BASE44_CMS\server.py (localhost:8000)
AccuRig: accurig-cli --serve --port 8189 (offline auto-rigging)
Lip-Sync: python viseme_server.py --port 8190 (Whisper + Wav2Lip + RVC)
Sovereign OmniStudio — Unified Blueprint
Zero APIs · Zero Cloud · Built From ScratchCentral Orchestrator + ComfyUI MCP + JuggleKnot Genome + Local LLM Stack — all 6 blueprints implemented
orchestrator.py — Sovereign OmniStudio Central Brain
E:\CLOUDY_DRIVE\orchestrator.py
Single unified FastAPI + WebSocket server that replaces all disparate servers. Accepts commands from any UI, dispatches to ComfyUI/Blender/LipSync, streams real-time progress.
"""
THE SOVEREIGN OMNISTUDIO — CENTRAL ORCHESTRATOR
FastAPI + WebSockets — Single brain for all engines.
Run: python orchestrator.py
Requires: pip install fastapi uvicorn websockets
Ports: REST :9000 | WebSocket ws://127.0.0.1:9000/ws
"""
import os
import json
import time
import uuid
import asyncio
import threading
import urllib.request
from fastapi import FastAPI, WebSocket, WebSocketDisconnect
from fastapi.middleware.cors import CORSMiddleware
from pydantic import BaseModel
app = FastAPI(title="Sovereign OmniStudio Orchestrator", version="3.0")
app.add_middleware(CORSMiddleware, allow_origins=["*"], allow_methods=["*"], allow_headers=["*"])
DRIVE_ROOT = r"E:\CLOUDY_DRIVE"
COMFY_URL = "http://127.0.0.1:8188"
BLENDER_WS = "ws://127.0.0.1:8765"
RIG_URL = "http://127.0.0.1:8189"
LIPSYNC_URL= "http://127.0.0.1:8190"
DAEMON_URL = "http://127.0.0.1:8191"
LLM_URL = "http://127.0.0.1:11434" # Ollama
active_ws_clients: list[WebSocket] = []
job_registry: dict = {}
# ─── WebSocket hub ───────────────────────────────────────────────────────────
async def broadcast(msg: dict):
dead = []
for ws in active_ws_clients:
try:
await ws.send_json(msg)
except Exception:
dead.append(ws)
for d in dead:
active_ws_clients.remove(d)
@app.websocket("/ws")
async def ws_endpoint(ws: WebSocket):
await ws.accept()
active_ws_clients.append(ws)
try:
while True:
data = await ws.receive_json()
await route_command(data, ws)
except WebSocketDisconnect:
active_ws_clients.remove(ws)
async def route_command(cmd: dict, ws: WebSocket):
action = cmd.get("action", "")
job_id = str(uuid.uuid4())[:8]
job_registry[job_id] = {"status": "running", "action": action}
await ws.send_json({"job_id": job_id, "status": "started", "action": action})
try:
if action == "RENDER_IMAGE":
result = await dispatch_comfy(cmd.get("workflow", {}), job_id)
elif action == "RENDER_SPRITES":
result = await dispatch_blender(cmd, job_id)
elif action == "AUTO_RIG":
result = dispatch_rig(cmd, job_id)
elif action == "LIP_SYNC":
result = dispatch_lipsync(cmd, job_id)
elif action == "LLM_CHAT":
result = await dispatch_llm(cmd.get("prompt", ""), job_id)
elif action == "STATUS":
result = await get_all_status()
else:
result = {"error": f"Unknown action: {action}"}
job_registry[job_id] = {"status": "done", "result": result}
await ws.send_json({"job_id": job_id, "status": "done", "result": result})
except Exception as e:
job_registry[job_id] = {"status": "error", "error": str(e)}
await ws.send_json({"job_id": job_id, "status": "error", "error": str(e)})
# ─── Engine dispatchers ───────────────────────────────────────────────────────
async def dispatch_comfy(workflow: dict, job_id: str) -> dict:
if not workflow:
workflow = default_txt2img_workflow()
payload = json.dumps({"prompt": workflow}).encode()
req = urllib.request.Request(f"{COMFY_URL}/prompt", data=payload,
headers={"Content-Type": "application/json"})
resp = urllib.request.urlopen(req)
return {"comfy_job": json.loads(resp.read()).get("prompt_id", "queued")}
async def dispatch_blender(cmd: dict, job_id: str) -> dict:
import websockets
async with websockets.connect(BLENDER_WS) as ws:
await ws.send(json.dumps({
"action": "AUTO_RIG_AND_RENDER_PNG",
"mesh_path": cmd.get("mesh_path", ""),
"angles": cmd.get("angles", 8),
"output_dir": os.path.join(DRIVE_ROOT, "05_OUTPUT_STREAM", "sprites"),
}))
return json.loads(await ws.recv())
def dispatch_rig(cmd: dict, job_id: str) -> dict:
data = json.dumps({"mesh_path": cmd.get("mesh_path", "")}).encode()
req = urllib.request.Request(f"{RIG_URL}/auto-rig", data=data,
headers={"Content-Type": "application/json"})
resp = urllib.request.urlopen(req)
return json.loads(resp.read())
def dispatch_lipsync(cmd: dict, job_id: str) -> dict:
data = json.dumps({"audio_path": cmd.get("audio_path", "")}).encode()
req = urllib.request.Request(f"{LIPSYNC_URL}/transcribe", data=data,
headers={"Content-Type": "application/json"})
resp = urllib.request.urlopen(req)
return json.loads(resp.read())
async def dispatch_llm(prompt: str, job_id: str) -> dict:
"""Call local Ollama — completely offline, no API key needed."""
data = json.dumps({"model": "deepseek-coder:6.7b", "prompt": prompt, "stream": False}).encode()
req = urllib.request.Request(f"{LLM_URL}/api/generate", data=data,
headers={"Content-Type": "application/json"})
try:
resp = urllib.request.urlopen(req, timeout=60)
result = json.loads(resp.read())
return {"response": result.get("response", "")}
except Exception as e:
return {"error": f"LLM offline: {e}. Start Ollama: ollama serve"}
async def get_all_status() -> dict:
def ping(url):
try:
urllib.request.urlopen(url, timeout=1)
return "online"
except:
return "offline"
return {
"comfyui": ping(f"{COMFY_URL}/system_stats"),
"blender": "online" if True else "offline", # ws check
"accurig": ping(f"{RIG_URL}/status"),
"lipsync": ping(f"{LIPSYNC_URL}/status"),
"daemon": ping(f"{DAEMON_URL}/status"),
"ollama": ping(f"{LLM_URL}/api/tags"),
}
# ─── REST endpoints (for frontend polling) ──────────────────────────────────
@app.get("/status")
async def status():
return await get_all_status()
@app.get("/jobs")
async def list_jobs():
return {"jobs": list(job_registry.values())[-20:]}
@app.post("/render")
async def rest_render(body: dict):
job_id = str(uuid.uuid4())[:8]
result = await dispatch_comfy(body.get("workflow", {}), job_id)
return {"job_id": job_id, **result}
# ─── Default ComfyUI workflow (txt2img with SD1.5) ──────────────────────────
def default_txt2img_workflow():
return {
"4": {"inputs": {"ckpt_name": "v1-5-pruned-emaonly.ckpt"}, "class_type": "CheckpointLoaderSimple"},
"6": {"inputs": {"text": "a professional 3D character, full body, transparent background", "clip": ["4", 1]}, "class_type": "CLIPTextEncode"},
"7": {"inputs": {"text": "ugly, blurry, watermark", "clip": ["4", 1]}, "class_type": "CLIPTextEncode"},
"5": {"inputs": {"width": 512, "height": 512, "batch_size": 1}, "class_type": "EmptyLatentImage"},
"3": {"inputs": {"seed": 0, "steps": 20, "cfg": 7, "sampler_name": "euler", "scheduler": "normal",
"denoise": 1, "model": ["4", 0], "positive": ["6", 0], "negative": ["7", 0],
"latent_image": ["5", 0]}, "class_type": "KSampler"},
"8": {"inputs": {"samples": ["3", 0], "vae": ["4", 2]}, "class_type": "VAEDecode"},
"9": {"inputs": {"filename_prefix": "sovereign_render", "images": ["8", 0]}, "class_type": "SaveImage"},
}
if __name__ == "__main__":
import uvicorn
print("=" * 60)
print(" SOVEREIGN OMNISTUDIO — CENTRAL ORCHESTRATOR")
print(" REST: http://127.0.0.1:9000")
print(" WebSocket: ws://127.0.0.1:9000/ws")
print(" Drive: " + DRIVE_ROOT)
print("=" * 60)
uvicorn.run(app, host="127.0.0.1", port=9000, log_level="warning")
SOVEREIGN PORT MAP — ALL LOCAL, ALL YOURS:
:8188 ComfyUI:8765 Blender RPC:8189 AccuRig:8190 Viseme:8191 Watchdog:9000 Orchestrator:8800 MCP Bridge:11434 Ollama LLM
Sovereign Script Library
Download → Save to E:\CLOUDY_DRIVE\ → RunThese are the actual Python/Batch scripts that make every port functional. Download each file, save it to the path shown, then run LAUNCH_CLOUDY_CORE.bat to start all engines.
LAUNCH_CLOUDY_CORE.bat
E:\CLOUDY_DRIVE\
One-click master bootloader — starts all 5 engine services
watch_inputs.py
E:\CLOUDY_DRIVE\02_SCRIPTS_CMD\
Folder watcher — detects new files and dispatches to ComfyUI + Blender
blender_rpc.py
E:\CLOUDY_DRIVE\01_ENGINES\
Headless Blender RPC server — 8-angle PNG renders with transparent backgrounds
server.py
E:\CLOUDY_DRIVE\03_BASE44_CMS\
FastAPI bridge server — connects Base44 frontend to local engines
accurig_server.py
E:\CLOUDY_DRIVE\01_ENGINES\
Local auto-rigging server (AccuRig or Blender headless) — runs on :8189
viseme_server.py
E:\CLOUDY_DRIVE\01_ENGINES\
Lip-sync & viseme engine — Whisper transcription + blendshape mapping on :8190
requirements.txt
E:\CLOUDY_DRIVE\02_SCRIPTS_CMD\
Python dependencies — pip install -r requirements.txt
SETUP INSTRUCTIONS:
- Create the directory structure on E:\CLOUDY_DRIVE\ (01_ENGINES through 05_OUTPUT_STREAM)
- Download all 7 scripts above and save each to its shown path
- Install Python dependencies: pip install -r requirements.txt
- Install Blender 3.6+ and ensure it's in your PATH
- Run E:\CLOUDY_DRIVE\LAUNCH_CLOUDY_CORE.bat
- Install ComfyUI separately (it runs on :8188)
- Drop a .png image into 04_INPUT_WATCHER\ — the pipeline runs automatically
Cloudy Comfort Engine
Cover · Magazine · Graph · Background · Bot AssignmentsCloudy Comfort Engine
Cover · Magazine · Graph · Background · Sovereign Bot Assignments
Drive Not Connected
Layout Sovereign
Layout Engine
Composes page layouts, grid systems, typography hierarchies
idle
Cover Sovereign
Cover Art Engine
Generates cover artwork, book jackets, magazine covers
idle
Graph Sovereign
Graph Render Engine
Renders charts, data visualizations, infographics
idle
Background Sovereign
Background Engine
Creates scene backgrounds, textures, environment plates
idle
Dispatch New Job
Assigned to: Cover Sovereign
Job Queue
0 totalNo jobs dispatched yet. Create one above.
Notebook UI→Sovereign Bot Assignment→EngineJob Record→RenderManifest→E:\CLOUDY_DRIVE\cloudy_comfort\
📝 Markdown · [1]
🐍 Python · [2]
CLOUDY COLLABORATIONS COMMUNITY TV
STANDBY4K
COMMUNITY SPOTLIGHT
LOOKING BEYOND
SOVEREIGN BROADCAST NETWORK
BROADCAST CONTROL
SOVEREIGN TOOLS
NOW PLAYING
360° Movement — Full Scene
Feed 1 of 5
SIGNAL
BUILT FROM SCRATCH — LOOKING BEYOND GLOBAL — SOVEREIGN ECOSYSTEM — ZERO API — ZERO THIRD PARTIES — CLOUDYFACES — CLOUDY RAISE — PHLEBOTOMY — CLOUDY TUBES — CLOUDYBUILT FROM SCRATCH — LOOKING BEYOND GLOBAL — SOVEREIGN ECOSYSTEM — ZERO API — ZERO THIRD PARTIES — CLOUDYFACES — CLOUDY RAISE — PHLEBOTOMY — CLOUDY TUBES — CLOUDY