Files · OpenAI Voice Agent for Square Online Order Status Inquiries

# OpenAI Voice Agent for Square Online Order Status Inquiries
 
Let customers call and check their Square Online order status with a conversational AI that looks up real-time order data.
 
## Architecture
 
Inbound Twilio call → webhook returns TwiML with Media Stream → WebSocket receives audio → Deepgram STT → OpenAI LLM classification → Square API order lookup → Cartesia TTS → audio sent back via WebSocket
 
## REAA Packages (7)
 
- `@reaatech/voice-agent-core` — Pipeline orchestrator, latency budgeting, session management
- `@reaatech/voice-agent-stt` — Speech-to-text via Deepgram
- `@reaatech/voice-agent-tts` — Text-to-speech via Cartesia
- `@reaatech/voice-agent-telephony` — Twilio Media Streams handler
- `@reaatech/session-continuity` — Multi-turn conversation state management
- `@reaatech/confidence-router` — Intent routing based on confidence thresholds
- `@reaatech/llm-cost-telemetry` — LLM cost tracking and telemetry
 
## Setup
 
Copy `.env.example` to `.env` and fill in the required values:
 
- Twilio: `TWILIO_ACCOUNT_SID`, `TWILIO_AUTH_TOKEN`, `TWILIO_PHONE_NUMBER`
- Square: `SQUARE_ACCESS_TOKEN`
- OpenAI: `OPENAI_API_KEY`
- Deepgram: `DEEPGRAM_API_KEY`
- Cartesia: `CARTESIA_API_KEY`
- Langfuse: `LANGFUSE_PUBLIC_KEY`, `LANGFUSE_SECRET_KEY`
 
## Development
 
```bash
pnpm install
pnpm dev
pnpm typecheck
pnpm lint
pnpm test
```
 
## License
 
MIT