DeepDish OCS
An Optical Control System for my Computer
Overview
I made a cyberpunk eye that watches you. It runs on a Gakken Worldeye display and uses a webcam to track subjects in real-time. The eye follows you, blinks naturally, and can make different expressions. You can control it manually through a web interface, desktop app, or give API control to other applications.
What It Does
👁️ The Eye
A colorful glowing eye that looks alive. It tracks where you're looking, dilates its pupils, and makes expressions like happy, sad, confused, suspicious, etc. It even blinks and has an idle animation when nobody's around.
📹 Face Tracking
Uses computer vision to detect your face and follow your head movements. The eye smoothly tracks you around the room with customizable sensitivity. You can adjust how responsive it is or flip the tracking if your camera is mirrored.
Red crosshairs mark tracked faces in the camera feed, showing exactly where the system is detecting and following your head position in real-time.
🧠 LLM Integration
The system has built-in support for local LLM APIs. Hook it up to any OpenAI-compatible endpoint to give the eye personality. The eye can respond to what you're doing, make expressions based on generated responses, and even have conversations.
🕰️ Grandfather Clock Chime
On the hour, every hour, the eye plays a clock chime animation. The eye phases into a cybernetic clock face, chimes the hour with sound effects, then phases back to normal.
📊 Prometheus Metrics & Grafana
The system exports real-time metrics in Prometheus format. Track eye gaze position, blink frequency, expression history, tracking accuracy, LLM response times, and more. Integrate with Grafana to visualize the eye's behavior over time, create dashboards for live monitoring, and set up alerts for unusual activity.
Built With
Python + OpenCV + Flask. Simple stuff to make something cool.
What's Next
Want to add more expressions, improve the tracking, better mobile interface, maybe integrate drones for surveillance vibes, and AI emotion detection from your face.
A cyberpunk eye that watches
Made for the Gakken Worldeye
Return Home
Back to main page