AR Craft Academy

IMAG 2018 Summer Games Team

Project Description

AR Craft Academy helps players learn how to operate a T6-Texan II using augmented reality to first teach and then test the player’s understanding of key procedures. This game was built as a proof of concept over the course of 8 weeks as part of the Booz Allen Hamilton 2018 Summer Games Internship. Our team of 5 interns went on to present our work at Washington DC in front of a crowd of over 500 people, including top-ranking VPs of the company. Our team placed 2nd out of over 80 participating teams.

What I Contributed

  • Led our team’s design process, established a safe and inclusive design space, and built alignment around a shared vision.
  • Directed iterative design process based on playtesting by identifying representative user groups and regularly gathering and responding to player feedback.
  • Designed the Guided Learning Mode and Test Mode along with appropriate guidance and feedback systems.
  • Set sprint goals and deadlines and helped the team establish an effective workflow using JIRA.
  • Implemented key features including major UI elements and interactions, backend for the learning and test segments of the game, and diegetic guidance systems.

Details/Features

AR Model

The Player initially places a to-scale 3D model of the cockpit of the T6 in the world. This feature enables players to build a spatial understanding of the positioning of key instruments within the cockpit without needing access to a real cockpit or simulator.

Glossary Mode

After placing the model, the Player initially begins in Glossary mode, where each element of the cockpit can be uniquely selected. Selected elements are highlighted and the name, a brief text description, an option for additional detail, and controls for playing a voiced audio recording are displayed. This engages multiple learning pathways, enabling the Player to choose the method of learning that best fits their needs.

Guided Learning Mode

In this mode, the Player selects their desired procedure and receives both written and voiced step-by-step instructions while the next instrument in the procedure displays a radial highlighting effect. Though not shown, if the instrument is out of view, an additional UI element shows the Player which direction they must turn to see the instrument.

Test Mode

In this mode, the Player selects their desired procedure and must then select the instruments in the order that matches the procedure. Instruments are highlighted green or red based on whether they are selected in the correct order and the Player receives a score upon completion of the procedure.