📱
mobile-app

SnapTalk — Learn English with AI, from your photos

An AI-powered English learning app that turns everyday moments into conversation practice.

Duration

2024-01 - 2024-06

SnapTalk — Learn English with AI, from your photos

Tech stack

React NativeTypeScriptGoogle Gemini AIGoogle Firebase AnalyticsGoogle AdMobReact NativeTypeScriptGoogle Gemini AIGoogle FirebaseGoogle AdMob

Details

SnapTalk — Learn English with AI, from your photos

SnapTalk is a language-learning app that lets you hold natural English conversations with an AI based on photos you take — turning ordinary moments into meaningful practice.

💡 Overview

Most English apps rely on fixed textbooks and canned scenarios. SnapTalk instead uses your real life and interests as the learning material, making practice more personal and practical.

🌟 Key features

📸 Photo-based conversations

Snap a moment from your day and talk about it with the AI in English. Conversations reflect your own context and interests, so they feel natural rather than scripted.

🎓 Personalized learning

The experience adapts to your interests and daily life, generating content tuned to your patterns and preferences.

🤖 Real-time AI dialogue

Powered by Google Gemini, the AI understands the content of your photo and responds with context-aware questions and feedback.

🎤 Pronunciation practice

Speech recognition analyzes your pronunciation in real time and suggests concrete improvements.

🚀 How it was built

Planning & design

  • Researched user needs and defined the core features
  • Designed the AI-driven learning flow
  • Designed an intuitive UI/UX

Core implementation

  • Cross-platform app built with React Native
  • Integrated and tuned the Google Gemini AI API
  • Built the speech recognition and processing pipeline
  • Managed data and analytics with Firebase

Optimization & launch

  • Performance tuning and user testing
  • Compliance with Google Play Store policies
  • Monetization with AdMob

🎯 Outcome

The project reimagined traditional English learning by tying practice closely to the user's daily life, and successfully delivered a system that generates personalized learning content with AI.

🔮 What's next

  • More learning scenarios
  • Stronger progress tracking and analytics
  • Expanded multi-language support
  • Community features

Explore more projects

Back to home