BigBlueFactory — video calls with an AI layer
A proprietary video communication platform with real-time transcription and a built-in assistant. Runs in the browser, no install. No lock-in to Zoom or Meet.
Video callsAIReal-time
About the project
A custom video calls platform with real-time speech transcription and a built-in assistant that reacts to the conversation without getting in the way. It runs in the browser, no install required. We built it on open-source infrastructure — no lock-in to Zoom or Meet, with full control over the data and room for deep integration with the client's processes.
Demo
Where it works
- Online consultations and sales. The manager talks to the client while the bot pulls stock, pricing and open calendar slots straight from the CRM.
- Legal and notary meetings. A verifiable transcript of the conversation with timecodes.
- Education and corporate training. Real-time subtitles and lecture translation, automatic notes.
- HR interviews. Structured notes and reactions to the candidate's key competencies.
- International negotiations. A bilingual interface — no external interpreters.
What can be added
- Pluggable LLMs for semantic triggers.
- Meeting summary and action items at the end of the call.
- CRM, ERP and calendar integrations — the bot executes actions, not just displays data.
- Voice commands to the assistant right inside the call.
- Group calls via SFU and server-side audio capture (FreeSWITCH `mod_audio_fork`).
Stack
- FrontendReact + Vite
- BackendNode.js, Express, WebRTC
- TranscriptionElevenLabs Scribe v2 (any voice-to-text model works)
- TranslationGoogle Translate API (any translation API works)
- Video serverBigBlueButton 3.0 (demo setup)
- OSUbuntu 22.04
What it gives you
Your own video product with an AI layer on top of open-source infrastructure. It plugs into an existing architecture — or sits as a second layer over Zoom and Meet via an on-screen overlay. Demo available on request.