Back to Projects
AIFeatured

AlphaCare

AI-Powered Healthcare Chatbot with real-time symptom screening and voice interaction.

Overview

A real-time healthcare assistant powered by Google Gemini, Vapi API, Firebase, and TypeScript for symptom screening and voice interaction. Features a voice-first interface and personalized feedback system.

localhost:3000/alphacare
AlphaCare Interface

// System Diagnostics & Performance Metrics

latency280ms (Voice RT)
accuracy96.5% Screening
costReduction35% Support Cost
throughput120 active calls/min
guardrailsNeMo Guardrails & Custom Regex
tokensProcessed12M/mo

// Core Pipeline & Systems Architecture Flow

Sequential data ingestion, processing, representation model routing, and generation steps.

1

Voice Input (WebRTC/SIP)

Captures user speech audio streaming through browser client.

2

Speech-To-Text (Vapi API)

Performs low-latency acoustic transcription to text input.

3

Gemini Orchestrator

Processes user dialogue, performs clinical intent matching and screening.

4

Firebase State Store

Updates patient session, symptoms log, and screening progress.

5

Text-To-Speech Output

Synthesizes low-latency natural human-sounding voice response.

The Challenge (Bottlenecks)

Technical Obstacles

Voice-based screening suffered from high audio latency, transcription errors for complex medical terms, and state synchronization across Gemini and Vapi APIs.

The Solution (Architectural Choice)

Engineering Solution

Optimized speech-to-text configurations, integrated Vapi API for sub-second streaming audio loopback, built a structured fallback state machine in Node.js, and implemented a custom LLM symptom validation layer.

Key Features

Real-time healthcare assistant powered by Gemini
Voice-first interface using Vapi API
Personalized feedback system
45% better voice-based interaction flow

Tech Stack

Next.jsReact.jsNode.jsFirebaseTailwind CSSVapi APIGoogle GeminiTypeScript