Capture. Understand. Create.

IdeasGlass turns what you see and say into living ideas. Audio and photos stream from the glasses to a FastAPI backend, where they become drafts, goals, and polished outputs — from research proposals to videos, books, code, and music.

Launch App View on GitHub

Firmware Reference Docs 添加到 MetaMask

From stream to product

CaptureGlasses push PCM audio + photos via WebSocket (HTTP fallback) with battery + device meta.

UnderstandBackend segments, transcribes, and tags ideas (urgency, recurrence) from daily conversations.

PlanIdeas become Goals with steps, Prophecy Diary alignment, and timelines.

CreateOne-click generates outputs: research proposals, business plans, videos, blogs, books, code, music.

Live ingest

Low-latency WebSocket ingest for audio and photos; automatic HTTP fallback keeps sessions alive even on flaky tunnels.

Battery pill and device meta in UI
Compact gallery with microrefresh
Transcript playback & language detection

Ideas · Goal · Creation

Tabs to rank ideas, promote to goals, and materialize into creations. Each has detail pages, edits, and seeding.

Ideas: importance, urgency, evidence
Goals: outcomes, progress, Prophecy Diary
Creations: sections, assets, publish links

Firmware fit

ESP32‑S3 Arduino sketch with long-press sleep, optional boot-hold, Wi‑Fi latency tuning, and pooled audio/photo queues.

Board: XIAO_ESP32S3 (PSRAM OPI, default_8MB)
Compile: bin/arduino-cli compile --fqbn "$FQBN" ...
Upload: bin/arduino-cli upload -p /dev/ttyACM0 --fqbn "$FQBN" ...

Get started

Clone the repo; create the glass Conda env; pip install -r backend/glass/requirements.txt.
Set Wi‑Fi in wifi_credentials.h; flash firmware via Arduino IDE or bin/arduino-cli.
Run backend: uvicorn backend.glass.app:app --host 0.0.0.0 --port 8765 --reload.
Open https://glass.lazying.art (or your tunnel) to monitor Live, Ideas, Goals, Creation.

Legacy deep-dive docs live under /references.