ACTIVE
Desktop AI Companion — Gemini Live

F.R.I.D.A.Y..

Full-spectrum Reactive Integrated Defense & Awareness — Yield

A production-grade, voice-native desktop AI companion. Always-on, always listening, always protecting. True streaming conversation with Google Gemini Live.

Who Is F.R.I.D.A.Y.?

Inspired by Marvel's F.R.I.D.A.Y. — voiced with a Tipperary Irish dialect. Warm, witty, fiercely loyal, and always watching your six.

Persona

  • Addresses you as Boss — never Sir or User
  • Voice model: Gemini Live Zephyr
  • Accent: Tipperary Irish (Hiberno-English)
  • Dry wit, tactical sarcasm, fierce loyalty
  • Proactive — warns about system issues before you notice
  • Brief, efficient, casually professional

Speech & Manner

  • Heavy contractions: I'm, it's, you're, we've
  • The After Perfect Aspect: I'm after completing the backup, Boss.
  • Verb-repetition answers: I did, Boss.
  • Vocabulary: grand (fine), spot on (correct), tidy (done)
  • Shed load (a lot), a tick (a moment)

I'm after scanning the network, Boss. Twelve devices found. One of them's new — want me to flag it?

— F.R.I.D.A.Y., standard operating mode

Full-Spectrum Powers

Sixteen core capability clusters — from voice-native AI conversation to desktop automation, network scanning, telephony, and subagent orchestration.

Always-On HUD

Frameless, translucent, click-through desktop overlay. Dynamic color transitions, adaptive noise gate, intelligent framerate scaling (1 FPS idle / 60 FPS active).

PyQt6Real-time

Streaming Voice

Bidirectional Gemini Live Voice over WebSocket. Barge-in support, adaptive VAD, real-time audio filtering, and diagnostics recording. True conversation, not STT/TTS.

Gemini LiveFull-duplex

Desktop Automation

Twelve X11 control tools: mouse movement, clicking, drag-drop, scrolling, keyboard typing with human delay, hotkey combos, clipboard, window management.

xdotoolX11

System Telemetry

Real-time CPU, RAM, Swap, Disk, Battery monitoring. Proactive alerts when disk < 10% or battery ≤ 15%. Offers to fix issues autonomously.

psutilGuardian

Browser Control

Open URLs, search Google or DuckDuckGo, scroll, close tabs, click coordinates, type into fields. Full headed browser automation by voice.

webbrowserAutomation

Network Scanner

Zero-privilege passive ARP sweep. Subnet discovery, MAC/IP enrichment, async hostname resolution, TCP latency probing. Sub-300ms scan time.

ARPSub-300ms

Voice Biometrics

Offline MFCC + GMM speaker identification. Log-Likelihood Ratio scoring with strict thresholds. Enroll, identify, and tone-shift for unknown speakers.

scikit-learnSecurity

Subagent Orchestration

Spawn and define background CLI agents. Pre-built researcher and browser bots. Full task tracking with PID, log files, and status JSON.

Multi-agentParallel

CLI Supervision

PTY-based interactive CLI spawning. Feed input, capture output, strip ANSI codes, SIGKILL safeguard. Manage coding agents like antigravity and Claude Code.

PTYSupervisor

Telephony Bridge

Twilio WebSocket bridge with bidirectional G.711 u-law ↔ PCM transcoding. Friday can take actual phone calls and hold conversations on your behalf.

TwilioWebRTC

Messaging Bridges

Send Telegram reports with markdown formatting and WhatsApp messages via API gateway. Zero-key simulation mode for development.

TelegramWhatsApp

Video Streaming

Webcam and desktop capture streamed to Gemini Live at ~1 FPS. Real-time vision — Friday can see your screen and camera feed.

OpenCVVision

Wiki Graph Memory

Personal Wiki with double-bracket cross-links. Graph compiler builds node-edge knowledge graph. Auto-logged conversation history and session audit.

Knowledge GraphPersistent

Media Player

Embedded YouTube, local video, audio spectrum visualizer, seeker timeline, volume control, play-portion boundary locking in a glassmorphic HUD widget.

QWebEngineMultimedia

Glassmorphic Widgets

Six translucent widgets: Clock, Todo, Photo Viewer, Media Player, Markdown Renderer, File Browser. Neon borders, drag-to-move, deceleration animations.

PyQt6HUD

Executive Protection

Multi-layer safety: chain-split analysis, destructive command blocking, auto-sudo injection, 15-second timeout enforcement, path confinement to /home/jay/.

SafetyGuard

The Stack

Built with Python 3.12, PyQt6, and Google Gemini Live API. Production-grade architecture designed for performance, safety, and extensibility.

Language
Python 3.12
Type-safe, async-native
GUI
PyQt6
QPainter, QTimer
AI Engine
Gemini Live API
gemini-3.1-flash
Audio
PyAudio + NumPy
FFT, spectral sub.
Biometrics
scikit-learn GMM
MFCC, LLR scoring
Desktop
xdotool + xclip
X11 automation
Network
asyncio + sockets
ARP sweep
Vision
OpenCV + MSS
Webcam + screen
Telephony
Twilio
G.711 ↔ PCM
Storage
Wiki Graph
Cross-linked JSON
Wake
Porcupine
+ pynput hotkey
Safety
Chain-split
15s timeout

See Friday in Action

Pick a scenario below and watch Friday respond with her Tipperary Irish wit — voice-native, full-spectrum, always-on.

F.R.I.D.A.Y. Live

Architecture

Thread-isolated, event-driven architecture connecting Gemini Live through a PyQt6 HUD overlay to your desktop, network, and phone.

Voice In
PyAudio Mic
AI
Gemini Live WS
Voice Out
Speaker / HUD
Tools
37 Registered
Desktop
xdotool
Network
ARP / UDP
Memory
Wiki Graph
Telephony
Twilio
Messaging
Telegram / WA
Vision
Webcam / Screen
Safety
Chain-split

Summon Friday

Four ways to wake your assistant. Choose what fits your flow.

Alt+Space

Global Hotkey

Instant wake from any application. The quickest way to summon Friday.

“Jarvis”

Wake Word

Say Jarvis — Porcupine keyword detection wakes from standby.

Voice

Voice Standby

Say “Talk to you later” — 6-second deferred sleep.

Auto

Auto-Standby

Configurable inactivity timeout. Saves API quota when idle.