Software UX enhancement using AI and NLP

Peter Darveau

Peter Darveau

Toronto, Ontario

1 0
  • 0 Collaborators

Voice Commander (VC) is an app that runs on the iPhone paired with an API on a host computer. VC allows the target software to accept voice commands. This function improves productivity on complexe software programs and assists visually impaired people to use these types of software. ...learn more

Project status: Published/In Market

Internet of Things, Artificial Intelligence

Intel Technologies
Intel CPU, Other, Intel Python

Links [1]

Overview / Usage

Our product consists of a software tool that uses a data model to interpret a set of voice commands to execute functions that would otherwise need to be performed manually. Currently, the model uses a database lookup and no learning algorithms which pose limitations to the application of the software and constraints to its functionality. Our solution includes the development of unsupervised (classification, association) and deep learning (NLP) models in the tool capable of adapting to different users and applications, minimizing time to configure the software across industries and improving performance.

Darveau, P. Prognostics and Availability for Industrial Equipment Using High Performance Computing (HPC) and AI Technology. Preprints 2021, 2021090068

Methodology / Approach

The product is commercially available.

We are following the 6sigma DMAIC methodology from a product development standpoint. The software development follows the SCRUM framework.

Methodology Used:

Problem Statement: Automate multiple events under one single keystroke

Measure: 1 event at a time.

Analyze: During your recording sessions, your midi/audio edits and the mixing phase you want to limit dull/repetitive clicks in order to iterate faster (experiments). Navigation scrolls through the timeline (horizontal axis) through tracks (vertical axis) is also time-consuming and markers can only help to a certain extent. Ultimately you want to automate multiple events under one single keystroke. If you merge two events into one, you are now going twice as fast! At the end of the day, it can really save you a lot of time in the studio. Now, how about 3 events or more? Maybe along these lines:

  1. Select the bass track.
  2. Solo it.
  3. Open each of the currently active plugins.

Implement: Identify issues and causes, consult with plant SMEs as required to validate.

Control: Design and Implement relevant Engineering Controls to address issues and make model improvements.

Technologies Used

The API runs on Intel Core i5 processor technology. Programming was done in C++ and Xcode

Comments (0)