AR Anatomical Platform with Generative AI Contextual Explanations
3Ducate layers augmented reality over anatomical models with AI explanations on demand. Built in 24 hours at HawkHack 2025 and awarded first place.
Date
January 2025
Duration
24 hours
Team
4 members
Category
EDTECH & AR
The Problem
Medical education relies on textbooks and 2D diagrams. Students struggle to understand 3D anatomy without expensive physical models or cadaver lab access. Existing digital solutions are static and non-interactive.
The Solution
An AR system that detects surfaces in real-time and overlays detailed anatomical models. Students tap any structure to receive a Gemini-powered natural language explanation instantly.
01
Real-time Surface Detection
Uses ARKit/ARCore to anchor models precisely onto physical surfaces.
02
AI-Powered Explanations
Gemini API generates contextual explanations for any selected anatomical structure on demand.
03
Multi-Model Library
Complete library from skeletal to muscular and vascular systems.
04
Offline Mode
Core AR functionality works without internet; AI explanations queue for later delivery.
Frontend
AI / ML
Backend
Infrastructure