Generate a CV for this Job!
Based on your profile and this job description, you can create a tailored CV to apply directly.
Node.js Engineer – Build Modular AI Voice & Clinical Assistant
Upwork • , US • Remote
Posted on: 26th March, 2025
Employment Type: Contractor
Job Description
• ********All AI written proposals will be deleted***************
Description:
We are building Zoe, an AI-driven assistant for dental practices. Zoe will start as a voice, SMS, and email agent for handling patient communication — and evolve into a clinical room assistant that listens to the doctor, transcribes treatment plans, and confirms chart entries in real time.
We’re looking for a Node.js expert to help design and implement Zoe as a modular microservice, starting with:
Voice call streaming (Twilio or LiveKit)
Audio transcription (Deepgram)
GPT-4 integration for intent recognition
Text-to-speech (ElevenLabs)
Output routing (voice, SMS, email, UI)
Integration with our backend via REST or messaging
You will also help lay the foundation for the in-room clinical assistant, which listens via mic, transcribes the dentist's narration, extracts structure from the text (perio charts, tooth procedures), and confirms it verbally with the doctor.
✅ Responsibilities:
Design a modular Node.js microservice architecture for Zoe
Build pluggable input handlers (Twilio, SMS, email, mic)
Integrate transcription, LLM (OpenAI), and TTS modules
Create real-time output for phone, SMS, email, and UI
Ensure the system is HIPAA-ready (encryption, logging, scoped access)
Collaborate with our .NET and Dart teams for integration
Build scalable patterns for multi-tenant routing and patient context
🧠 Requirements:
Strong experience with Node.js, TypeScript preferred
Familiarity with audio streaming, WebSockets, and voice APIs
Experience integrating with Deepgram, OpenAI (GPT-4), ElevenLabs
Ability to design modular, testable, and scalable backend services
Knowledge of HIPAA-compliant backend patterns (bonus)
Experience with LiveKit or Twilio Voice (preferred)
Strong communication — we work async but stay tightly aligned
🚀 Bonus Skills:
Experience with Temporal, Redis, or SQS
NLP or entity extraction experience (dental/medical a plus)
Familiarity with PostgreSQL and multi-tenancy
Description:
We are building Zoe, an AI-driven assistant for dental practices. Zoe will start as a voice, SMS, and email agent for handling patient communication — and evolve into a clinical room assistant that listens to the doctor, transcribes treatment plans, and confirms chart entries in real time.
We’re looking for a Node.js expert to help design and implement Zoe as a modular microservice, starting with:
Voice call streaming (Twilio or LiveKit)
Audio transcription (Deepgram)
GPT-4 integration for intent recognition
Text-to-speech (ElevenLabs)
Output routing (voice, SMS, email, UI)
Integration with our backend via REST or messaging
You will also help lay the foundation for the in-room clinical assistant, which listens via mic, transcribes the dentist's narration, extracts structure from the text (perio charts, tooth procedures), and confirms it verbally with the doctor.
✅ Responsibilities:
Design a modular Node.js microservice architecture for Zoe
Build pluggable input handlers (Twilio, SMS, email, mic)
Integrate transcription, LLM (OpenAI), and TTS modules
Create real-time output for phone, SMS, email, and UI
Ensure the system is HIPAA-ready (encryption, logging, scoped access)
Collaborate with our .NET and Dart teams for integration
Build scalable patterns for multi-tenant routing and patient context
🧠 Requirements:
Strong experience with Node.js, TypeScript preferred
Familiarity with audio streaming, WebSockets, and voice APIs
Experience integrating with Deepgram, OpenAI (GPT-4), ElevenLabs
Ability to design modular, testable, and scalable backend services
Knowledge of HIPAA-compliant backend patterns (bonus)
Experience with LiveKit or Twilio Voice (preferred)
Strong communication — we work async but stay tightly aligned
🚀 Bonus Skills:
Experience with Temporal, Redis, or SQS
NLP or entity extraction experience (dental/medical a plus)
Familiarity with PostgreSQL and multi-tenancy
Responsibilities
- Zoe will start as a voice, SMS, and email agent for handling patient communication — and evolve into a clinical room assistant that listens to the doctor, transcribes treatment plans, and confirms chart entries in real time
- Voice call streaming (Twilio or LiveKit)
- Integration with our backend via REST or messaging
- You will also help lay the foundation for the in-room clinical assistant, which listens via mic, transcribes the dentist's narration, extracts structure from the text (perio charts, tooth procedures), and confirms it verbally with the doctor
- Design a modular Node.js microservice architecture for Zoe
- Build pluggable input handlers (Twilio, SMS, email, mic)
- Integrate transcription, LLM (OpenAI), and TTS modules
- Create real-time output for phone, SMS, email, and UI
- Ensure the system is HIPAA-ready (encryption, logging, scoped access)
- Collaborate with our .NET and Dart teams for integration
- Build scalable patterns for multi-tenant routing and patient context
Requirements
- GPT-4 integration for intent recognition
- Familiarity with audio streaming, WebSockets, and voice APIs
- Experience integrating with Deepgram, OpenAI (GPT-4), ElevenLabs
- Ability to design modular, testable, and scalable backend services
- Knowledge of HIPAA-compliant backend patterns (bonus)
- Strong communication — we work async but stay tightly aligned
- Experience with Temporal, Redis, or SQS
- Familiarity with PostgreSQL and multi-tenancy
Upwork
Technology
Job Type
Contractor
Loading...
Loading...
AI Cover Letter Generator
Generate a Tailored Cover Letter!
Our AI will analyze your profile and create a personalized cover letter that highlights your relevant skills and experience.
Related Jobs
Upwork
4 weeks ago
Full-Stack Developer for Inventory Management SaaS Application (React + Node.js with Metronic) - Contract to Hire
, US
View Job