TaskTape AR Features Spike
Chris Mathias
Austin, Texas
- 0 Collaborators
A Spike to produce proof-of-concept AR/AI features for the TaskTape program. These demo features when tightened up will be included in Walkthrough by TaskTape https://itunes.apple.com/us/app/walkthrough-by-tasktape/id1336050583?ls=1&mt=8 ...learn more
Project status: Under Development
Mobile, Artificial Intelligence
Intel Technologies
OpenVINO
Overview / Usage
This is a Spike to produce a Proof of Concept (POC) and as such, is just a simple menu UI that takes the user to a demo-version of each intended feature.
Two features are implemented so far:
Job FinderIntended for use when the user is looking at the Job List and deciding where to go next.
Job Finder uses Core Location + AR & the ARCL library to present job images, names, and distance in a AR context (live camera + AR) to let the user
"take a look around" to see roughly the direction their jobs are in, and how far away.
Once the user selects a job they can tap on it, and from there be given the option to "open in maps" or "view job details".
Intended for use when the user is new to the job and trying to locate where on the job site a particular Area is located.
Area Finder uses Core Location heading data + ARKit to create a "finder arrow" that constant updates relative to the users position
to literally "point them in the right direction".
Methodology / Approach
One of the missions at SolipsAR is to find ways to go beyond the AR hype and attempt to develop useful AR applications. Walkthrough by TaskTape is an excellent tool for its intended purpose, and we believe additional value can be added through the use of Augmented Reality.
AR is a tough sell in the handset format, and we are very excited to pursue headset-based apps and ideas, but firmly believe that for the next 18 - 60 months, AR's primary delivery mechanism will remain the handset (mobile phones).
This project is a first cut at what AR features might be useful in a handset format for the TaskTape product.
We work with a product manager, as well as users of the app, to determine interest in different ideas we have for using advanced technologies such as AR and ML to push the envelope. While the AR features are generally non-critical to the core use case for the app, users do find them interesting and useful.
We are prototyping these features using IOS and ARKit but will also be developing for Android.
Technologies Used
Insofar as the apple IOS devices and macbooks for development use Intel technologies, we are using intel tech. Additionally, we are working on building out the same app on Android. As we are just getting started with the Intel programs, we are beginning to explore how we might use some of the Intel software technologies also for the CV & ML cases.
Other tech includes:
- ARKit
- ARCL
- CoreLocation
We are excited to start looking at OpenVino to increase the AR capabilities particularly around the TapeCreator and TapeFinder features.
Repository
https://github.com/revelfire/tasktape-ar-spike/tree/master/TasktapeARFeatures