AI Tutoring Whiteboard

A smart whiteboard that listens, sees, and teaches. Students can draw naturally, talk to the tutor with their voice or text, and get real-time, pedagogically sound guidance.

About This Project

AI Tutoring Whiteboard is a multimodal learning platform that merges visual work and conversation into a single flow. Unlike other tutoring tools that separate whiteboard interactions from chat, this project allows the AI to 'see' the board, listen to the student, and respond with voice, text, and visual aids simultaneously. Built with React, TypeScript, and cutting-edge AI services, it features interactive canvas drawing, voice input via Web Speech API, vision analysis of student work via Google Gemini 2.0 Flash, natural voice responses through ElevenLabs, and customizable tutoring 'pushiness' levels (1-5) to fit individual learning preferences.

Key Features

  • Interactive whiteboard with pencil, eraser, color & line width controls
  • Voice input via Web Speech API for hands-free question asking
  • AI vision analysis of current canvas snapshot using Gemini 2.0 Flash
  • Customizable tutoring pushiness levels (1-5) for different learning styles
  • Natural voice responses using ElevenLabs text-to-speech
  • Optional background image upload for problem photos
  • Visual aids generation with Runware integration
  • Multi-tenant user authentication with Bolt Database RLS policies

Tech Stack

ReactTypeScriptViteTailwind CSSGoogle Gemini 2.0 FlashElevenLabs TTSRunwareBolt DatabaseWeb Speech APICanvas API