Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

Paulo Gurgel Pinheiro

Paulo Gurgel Pinheiro

, State of São Paulo

Demo for IDF16. How about driving a robotic wheelchair using facial expressions, head movement, eye tracking or speech recognition?

Intel RealSense™, Internet of Things, Robotics

  • 0 Collaborators

  • 51 Followers

    Follow

Description

IDF16 demo. Wheelie is a hands-free solution that uses Intel RealSense technology to drive robotic wheelchairs. Wheelie allows you to set up key expressions as commands. Let's take a ride!

1-Here are the options: full-smile, half-smile, wrinkle nose, eyebrows up, kiss movement, tongue out and puffed cheek. 2-Pick up 5 of them. 3-Wheelie links the expressions to a command to drive the wheelchair: moving forward, backward, turning right, left and stop.

After a stroke some patients may have different restrictions on controlling facial muscles. Wheelie offers 7 different facial expressions to be selected, but sometimes using the head is the best way to go. Wheelie and Intel® RealSense™ can together track you head position using the pitch, the roll and yaw translating these movements into wheelchair commands.

Commands based on speech recognition are also available.

Brazilian researchers develop face-controlled wheelchair:

New Version:

Facial Expressions:

Head movements:
Voice:

Gallery

Links

HOO.BOX Wheelie

Medium 13438942 1111118112283022 3679370435112256455 n  1

MAQBOOL T. added a comment on project Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

Medium d8e270a1 0a1c 42e5 97a6 f556e928c975

Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

IDF16 demo. Wheelie is a hands-free solution that uses Intel RealSense technology to drive robotic wheelchairs. Wheelie allows you to set up key expressions as commands. Let's take a ride!

1-Here are the options: full-smile, half-smile, wrinkle nose, eyebrows up, kiss movement, tongue out and puffed cheek. 2-Pick up 5 of them. 3-Wheelie links the expressions to a command to drive the wheelchair: moving forward, backward, turning right, left and stop.

After a stroke some patients may have different restrictions on controlling facial muscles. Wheelie offers 7 different facial expressions to be selected, but sometimes using the head is the best way to go. Wheelie and Intel® RealSense™ can together track you head position using the pitch, the roll and yaw translating these movements into wheelchair commands.

Commands based on speech recognition are also available.

Brazilian researchers develop face-controlled wheelchair:

New Version:

Facial Expressions:

Head movements:
Voice:

Medium 0 1ns afha 3r4nookq1lqyasci1nli oflblzujalt8nniojdkpkqmirqkpbjntoxipkks7lqi5bn3ijsijpgjpabn5bq3i2c8jprufdc3x6j3ngi8m2aonjsze

Fernando S. added a comment on project Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

Medium d8e270a1 0a1c 42e5 97a6 f556e928c975

Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

IDF16 demo. Wheelie is a hands-free solution that uses Intel RealSense technology to drive robotic wheelchairs. Wheelie allows you to set up key expressions as commands. Let's take a ride!

1-Here are the options: full-smile, half-smile, wrinkle nose, eyebrows up, kiss movement, tongue out and puffed cheek. 2-Pick up 5 of them. 3-Wheelie links the expressions to a command to drive the wheelchair: moving forward, backward, turning right, left and stop.

After a stroke some patients may have different restrictions on controlling facial muscles. Wheelie offers 7 different facial expressions to be selected, but sometimes using the head is the best way to go. Wheelie and Intel® RealSense™ can together track you head position using the pitch, the roll and yaw translating these movements into wheelchair commands.

Commands based on speech recognition are also available.

Brazilian researchers develop face-controlled wheelchair:

New Version:

Facial Expressions:

Head movements:
Voice:

Untitled

Paulo P. added photos to project Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

Medium 23f32365 0fbf 4651 9483 c1d49475eac8

Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

IDF16 demo. Wheelie is a hands-free solution that uses Intel RealSense technology to drive robotic wheelchairs. Wheelie allows you to set up key expressions as commands. Let's take a ride!

1-Here are the options: full-smile, half-smile, wrinkle nose, eyebrows up, kiss movement, tongue out and puffed cheek.
2-Pick up 5 of them.
3-Wheelie links the expressions to a command to drive the wheelchair: moving forward, backward, turning right, left and stop.

After a stroke some patients may have different restrictions on controlling facial muscles. Wheelie offers 7 different facial expressions to be selected, but sometimes using the head is the best way to go. Wheelie and Intel® RealSense™ can together track you head position using the pitch, the roll and yaw translating these movements into wheelchair commands.

Commands based on speech recognition are also available.

Brazilian researchers develop face-controlled wheelchair:
https://www.youtube.com/watch?v=Ynt7-Acgta4

New Version:
https://www.youtube.com/watch?v=9NkDddZnQG0
https://www.youtube.com/watch?v=ve1nTNrD3FM
https://www.youtube.com/watch?v=ztucS4BeDWY

Facial Expressions:
https://www.youtube.com/watch?v=pr6U-t9uwKE
Head movements:
https://www.youtube.com/watch?v=4AwP4HyIWGE
Voice:
https://www.youtube.com/watch?v=CMFBxmR99l4”

Untitled

Paulo P. added photos to project Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

Medium 746b944e 613f 4897 8b94 d8a6e0950215

Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

IDF16 demo. Wheelie is a hands-free solution that uses Intel RealSense technology to drive robotic wheelchairs. Wheelie allows you to set up key expressions as commands. Let's take a ride!

1-Here are the options: full-smile, half-smile, wrinkle nose, eyebrows up, kiss movement, tongue out and puffed cheek.
2-Pick up 5 of them.
3-Wheelie links the expressions to a command to drive the wheelchair: moving forward, backward, turning right, left and stop.

After a stroke some patients may have different restrictions on controlling facial muscles. Wheelie offers 7 different facial expressions to be selected, but sometimes using the head is the best way to go. Wheelie and Intel® RealSense™ can together track you head position using the pitch, the roll and yaw translating these movements into wheelchair commands.

Commands based on speech recognition are also available.

Brazilian researchers develop face-controlled wheelchair:
https://www.youtube.com/watch?v=Ynt7-Acgta4

New Version:
https://www.youtube.com/watch?v=9NkDddZnQG0
https://www.youtube.com/watch?v=ve1nTNrD3FM
https://www.youtube.com/watch?v=ztucS4BeDWY

Facial Expressions:
https://www.youtube.com/watch?v=pr6U-t9uwKE
Head movements:
https://www.youtube.com/watch?v=4AwP4HyIWGE
Voice:
https://www.youtube.com/watch?v=CMFBxmR99l4”

Untitled

Paulo P. added photos to project Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

Medium 482352ee d119 4e52 bb06 bebb9b8a8e66

Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

IDF16 demo. Wheelie is a hands-free solution that uses Intel RealSense technology to drive robotic wheelchairs. Wheelie allows you to set up key expressions as commands. Let's take a ride!

1-Here are the options: full-smile, half-smile, wrinkle nose, eyebrows up, kiss movement, tongue out and puffed cheek.
2-Pick up 5 of them.
3-Wheelie links the expressions to a command to drive the wheelchair: moving forward, backward, turning right, left and stop.

After a stroke some patients may have different restrictions on controlling facial muscles. Wheelie offers 7 different facial expressions to be selected, but sometimes using the head is the best way to go. Wheelie and Intel® RealSense™ can together track you head position using the pitch, the roll and yaw translating these movements into wheelchair commands.

Commands based on speech recognition are also available.

Brazilian researchers develop face-controlled wheelchair:
https://www.youtube.com/watch?v=Ynt7-Acgta4

New Version:
https://www.youtube.com/watch?v=9NkDddZnQG0
https://www.youtube.com/watch?v=ve1nTNrD3FM
https://www.youtube.com/watch?v=ztucS4BeDWY

Facial Expressions:
https://www.youtube.com/watch?v=pr6U-t9uwKE
Head movements:
https://www.youtube.com/watch?v=4AwP4HyIWGE
Voice:
https://www.youtube.com/watch?v=CMFBxmR99l4”

Untitled

Paulo P. added photos to project Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

Medium d8e270a1 0a1c 42e5 97a6 f556e928c975

Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

IDF16 demo. Wheelie is a hands-free solution that uses Intel RealSense technology to drive robotic wheelchairs. Wheelie allows you to set up key expressions as commands. Let's take a ride!

1-Here are the options: full-smile, half-smile, wrinkle nose, eyebrows up, kiss movement, tongue out and puffed cheek.
2-Pick up 5 of them.
3-Wheelie links the expressions to a command to drive the wheelchair: moving forward, backward, turning right, left and stop.

After a stroke some patients may have different restrictions on controlling facial muscles. Wheelie offers 7 different facial expressions to be selected, but sometimes using the head is the best way to go. Wheelie and Intel® RealSense™ can together track you head position using the pitch, the roll and yaw translating these movements into wheelchair commands.

Commands based on speech recognition are also available.

Brazilian researchers develop face-controlled wheelchair:
https://www.youtube.com/watch?v=Ynt7-Acgta4

New Version:
https://www.youtube.com/watch?v=9NkDddZnQG0
https://www.youtube.com/watch?v=ve1nTNrD3FM
https://www.youtube.com/watch?v=ztucS4BeDWY

Facial Expressions:
https://www.youtube.com/watch?v=pr6U-t9uwKE
Head movements:
https://www.youtube.com/watch?v=4AwP4HyIWGE
Voice:
https://www.youtube.com/watch?v=CMFBxmR99l4”

Medium untitled

Paulo P. created project Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

Medium d8e270a1 0a1c 42e5 97a6 f556e928c975

Wheelie - Using Intel RealSense Technology to drive Wheelchairs.

IDF16 demo. Wheelie is a hands-free solution that uses Intel RealSense technology to drive robotic wheelchairs. Wheelie allows you to set up key expressions as commands. Let's take a ride!

1-Here are the options: full-smile, half-smile, wrinkle nose, eyebrows up, kiss movement, tongue out and puffed cheek. 2-Pick up 5 of them. 3-Wheelie links the expressions to a command to drive the wheelchair: moving forward, backward, turning right, left and stop.

After a stroke some patients may have different restrictions on controlling facial muscles. Wheelie offers 7 different facial expressions to be selected, but sometimes using the head is the best way to go. Wheelie and Intel® RealSense™ can together track you head position using the pitch, the roll and yaw translating these movements into wheelchair commands.

Commands based on speech recognition are also available.

Brazilian researchers develop face-controlled wheelchair:

New Version:

Facial Expressions:

Head movements:
Voice:

Thumb 13438942 1111118112283022 3679370435112256455 n  1

MAQBOOL T.

woowww... good project

Thumb 0 1ns afha 3r4nookq1lqyasci1nli oflblzujalt8nniojdkpkqmirqkpbjntoxipkks7lqi5bn3ijsijpgjpabn5bq3i2c8jprufdc3x6j3ngi8m2aonjsze

Fernando S.

Gostaria de saber a estrutura do algoritmo desenvolvido para o rastreamento do olhar e qual foi o parâmetro para a captura das coordenadas X e Y com a câmera realsense?

No users to show at the moment.

Bigger 0 xqt6rxvqsgw838z24qy5o ntdjjq3mc5hly5isv v3wh3cq6hlyk2unbwfn7n2cqshyhwhzb44v6ixw7wxrw20vq74vqixl5sxrxmxwnvgx7ihn2srhl1dpuoh
  • Projects 1
  • Followers 3

Chris Barsolai

I live by the philosophy that 'Innovation is what matters'. Steered on empowering Africa's Maker community. I believe that with the power of collective action, social networks and crowdsourcing, individual action is amplified to have extraordinary influence on the larger systems that surround us. It starts at the smallest scale—with one person determined to make something happen—and can grow like wildfire to the extent our imaginations deem possible.

Nairobi, Kenya

Bigger 0 0gzkp9cdxgbkh6txsch syqwnaisgq1kicdnse6w9lcmgexketd9dfqdncuig6x3a0h iffubirixbooe9k0idbfrirwxbmfe9kty9u75aecxh0metnpnzsqxm
  • Projects 0
  • Followers 0

brad lindsey

first computer experience in the 1970's with Apple Desktops Apple II

534 Cypress St, Abilene, TX 79601, USA

Bigger photo
  • Projects 0
  • Followers 4

Aravind Sura

Hyderabad, Telangana, India

Bigger 0 1ns afha 3r4nookq1lqyasci1nli oflblzujalt8nniojdkpkqmirqkpbjntoxipkks7lqi5bn3ijsijpgjpabn5bq3i2c8jprufdc3x6j3ngi8m2aonjsze
  • Projects 0
  • Followers 0

Fernando SIlva

Av. Juscelino K. de Oliveira, 1361 - Cidade Industrial, Curitiba - PR, 81280-140, Brazil

Bigger j5oui22x 400x400
  • Projects 0
  • Followers 2

Thomas Jung

engineer, hacker, maker, federal hackathon winner.

Dallas, TX, USA

Bigger adam
  • Projects 3
  • Followers 4

Adam Milton-Barker

I am a self taught programmer with over 13 years experience in various aspects of the tech industry. I am involved in disruptive and non-disruptive tech from web/Facebook/mobile & desktop apps, to the IoT, A.I., BioHacking, BCI (Brain Computer Interface) apps and Robotics. My EcoSystem, the TechBubble Technologies EcoSystem, provides hyrbid web development, business administration systems, an IoT platform (JumpWay), IoT devices (IntelliLan), an AI platform, a news outlet and a robotics platform/social network are in development. In January 2016 I was a Semi Finalist in the Smart Homes category of the IBM/4YFN Global Mobile Innovators Tournament, I was also a first phaze winner in Microsoft/Arduino World Maker Challenge. More recently our team won the Intel Experts Award at the IoT Solutions World Congress for building a neural network on an Intel Joule and I am now an Intel Software Innovator.

Spain

Bigger 15401047 1148739835195254 9069293585294168756 n
  • Projects 0
  • Followers 6

Jay Patel

Undergrad Computer Engineering Student, learning to teach machines.

Nadiad, Gujarat, India

See More