Space Face: Facing Space with Grace
There is a great deal of interest from national space agencies to go to the Moon and Mars. ESA wants to go to the Moon and establish a village there. NASA wants to go to Mars. Astronauts and Cosmonauts from all over the world are already living aboard the ISS. What can they do in their free time? It can’t be all about reading books or game play on computers. Think of new sports or games that could take into account the low gravity (e.g. a space lacrosse game, extreme basketball). What about real or virtual experiences involving the Apollo 11 landing site on the Moon? Or following the paths of Sojourner, Spirit or Curiosity on Mars using a form of cross-country skiing? Think of new ways for to astronauts to use their free time. To present your results develop an app that makes use of virtual reality tools.
We built a system that passively monitors crew members on long-haul voyages and missions to detect any emotional and/or physical health issues and recommend recreational and work activities. We use image, video, and audio collections as crew members go about their business and run those samples against our machine learning engine to track general behavioral and emotional trends and detect issues before they become mission critical problems.
We implemented a microservices architecture with the following components, hosted on Microsoft Azure:
- IBM BlueMix (for voice emotion detection, voice-to-text transcription, and textual sentiment analysis)
- Microsoft Cognitive Services (for video and image emotion detection)
- NodeJS
- Flask
- AngularJS
- D3.js
- Express
- Proprietary Javascript
- Python for Data Analysis
Image, audio, and video samples currently supplied by consumer hardware, but can be trivially extended to small embedded devices and recording equipment.
