AI Assistant Jarvis

Inspired by the famous fictional character JARVIS from the marvel cinematic universe and driven by my desire to build immersive systems, I created an interactive AI-powered virtual assistant, JARVIS. It incorporates an AR avatar with features like a voice-enabled chatbot to bring a human-like conversational experience.

Workflow

  • An AR-compatible smartphone accepts user voice commands, begins speech recognition, and converts them into text.
  • Further, the text is sent to a cloud service (IBM Watson) running in the backend.
  • Next, text processing occurs, and corresponding command operations execute, which returns output to the smartphone as feedback.

Contributions

  • I designed and developed the simulation for JARVIS from scratch in Unity
  • I utilized Google’s ARCore SDK for integrating the AR experience.
  • I used the IBM Watson speech and text cloud services to add a chatbot feature.

[GitHub]