AI/ML & Systems | Desktop App

J.A.R.V.I.S. – Real-Time
Conversational AI Assistant

Ultra-low latency conversational agent orchestrating bidirectional audio streams, dynamic local/cloud LLM routing, and a synchronized WebGL visualizer canvas with zero server egress for confidential tasks.

WebSockets WebGL Shaders Local LLMs (Ollama) TypeScript & Node.js Tauri Desktop Core

Loop Latency

< 1.2s

End-to-end voice-to-voice turn around time with chunked audio streaming.

Privacy & Routing

100% Local

Zero third-party network calls for system control, file queries, and sensitive data.

Canvas Rendering

60 FPS

Hardware-accelerated reactive Arc-Reactor visualizer shader loop.

Visual Inspection

Desktop Interface & HUD Telemetry

Click any screen to inspect full resolution

Audio Visualizer and Idle State with Radial Arc-Reactor HUD

Idle Arc Reactor Inspect

Audio Visualizer & Idle State

Spatial radial HUD monitoring system thermals, network latency, and memory footprint.

Streaming Voice Response and Latency Waterfall

Live Dialogue Mode Inspect

Streaming Voice Response & Console

Chunked bidirectional audio loop with integrated live chat fallback & memory retrieval.

Tools & Routing Inspect

Dynamic Intent Routing Dashboard

Drawer telemetry exposing automated intent dispatch, YouTube automation, and local tool pipelines.

System Internals

End-to-End Pipeline Architecture

Audio Ingestion

Microphone stream into Silero VAD. 16kHz PCM ring buffer prevents audio clipping.

Silero VAD / Opus

Streaming STT

Sub-300ms speech-to-text token streaming with interim hypothesis correction.

Faster-Whisper / WS

Intent Router

Classifies prompt: Local Ollama (system ops) vs Cloud LLM (creative reasoning).

Adaptive Classifier

Vector Memory

Retrieves context from embedded semantic memory store before LLM execution.

ChromaDB / HNSW

Synthesis & HUD

Synthesizes voice tokens while driving reactive 60fps WebGL visualizer shaders.

WebGL / TTS Audio

Zero Remote Telemetry • Desktop Tauri Sandbox • Hardware Accelerated

Security Invariant: No raw audio persisted unencrypted

Developer Onboarding

Local Quickstart & Execution

powershell / bash — jarvis-assistant

Node v20+ / Rust / Tauri CLI

# 1. Clone repository from GitHub into your local workspace

git clone https://github.com/Naveenbnnavee/J.A.R.V.I.S.git && cd J.A.R.V.I.S

# Or pull latest changes into your directory if already cloned:

git pull origin main

# 2. Install frontend & backend dependencies

npm install ; cd backend ; npm install ; cd ..

# 3. Launch the desktop client with hot-reload

npm run dev

# 4. Optional: Run in standalone web mode for UI debugging

npx vite --port 1420

J.A.R.V.I.S. – Real-Time Conversational AI Assistant