Martin Foertsch
Black Belt

Martin Foertsch

Beta-Straße 13A, 85774 Unterföhring, Germany

Activity Feed

Mjvkm9o8

Martin F. added photos to project Project Avatar - An immersive, gesture controlled telepresence robotics system

Medium f43acf32 d346 4e03 857f 43c779329198

Project Avatar - An immersive, gesture controlled telepresence robotics system

"Avatar" is an American science fiction film by James Cameron premiered in the year 2009. The film is about humans from earth colonizing the planet Pandora which is populated by the local tribe Na'vi. Na'vis are a humanoid species indigenous in Pandora. To create trust the humans developed a system which makes it possible to incarnate as a real Na'vi. In the film Captain Jake Sully (Sam Worthington) slipped into the role of such a native of this local tribe on Pandora to accomplish one’s mission. With this very special human technology he was able to look and feel like a real Na'vi.

The goal of "Project Avatar" was to build a project where you can have such an out-of-body experience using off-the-shelf hardware. The idea was to control a robot at another location using full body gesture control. The teleoperator on the the remote is equipped with sensors to gather environmental data. Using feedback channels this data can be transferred back to the human controller.

The human operator actually should be able to see the world through the eyes of the Nao robot including the field of view in 3D. This is realizable by using RGB stereo cameras. Using tactile sensors the robot is able to send touch-events over the communication channel back to the human controller. So the controller can actually feel sensor based events occurring in the environment at the robots site comparable to force-feedback.

Our plan is to introduce the Intel RealSense camera for full body tracking and Intel Euclid as additional camera sensor to extend the senses of the Nao robot. The Intel IoT Gateway is implemented as well to transfer the huge amount of data seamlessly.

Medium mjvkm9o8

Martin F. created project Project Avatar - An immersive, gesture controlled telepresence robotics system

Medium f43acf32 d346 4e03 857f 43c779329198

Project Avatar - An immersive, gesture controlled telepresence robotics system

"Avatar" is an American science fiction film by James Cameron premiered in the year 2009. The film is about humans from earth colonizing the planet Pandora which is populated by the local tribe Na'vi. Na'vis are a humanoid species indigenous in Pandora. To create trust the humans developed a system which makes it possible to incarnate as a real Na'vi. In the film Captain Jake Sully (Sam Worthington) slipped into the role of such a native of this local tribe on Pandora to accomplish one’s mission. With this very special human technology he was able to look and feel like a real Na'vi.

The goal of "Project Avatar" was to build a project where you can have such an out-of-body experience using off-the-shelf hardware. The idea was to control a robot at another location using full body gesture control. The teleoperator on the the remote is equipped with sensors to gather environmental data. Using feedback channels this data can be transferred back to the human controller.

The human operator actually should be able to see the world through the eyes of the Nao robot including the field of view in 3D. This is realizable by using RGB stereo cameras. Using tactile sensors the robot is able to send touch-events over the communication channel back to the human controller. So the controller can actually feel sensor based events occurring in the environment at the robots site comparable to force-feedback.

Our plan is to introduce the Intel RealSense camera for full body tracking and Intel Euclid as additional camera sensor to extend the senses of the Nao robot. The Intel IoT Gateway is implemented as well to transfer the huge amount of data seamlessly.

Mjvkm9o8

Martin F. added photos to project Augmented Rift

Medium e0baeabc 190c 4768 84a8 cf313e0b887d

Augmented Rift

The hardware hacking team from TNG Technology Consulting GmbH started to work on a device which is capable to do full field of view augmented reality in March 2015 when the company’s winter retreat was taking place.

The mobile “TNG Augmented Rift” is a full field of view Augmented Reality device capable to do e.g. face tracking, face identification, emotion detection, heart rate detection, distance measurements, etc. Speech recognition for command and control is implemented as well.

The goal was to build a device made with off-the-shelf hardware in one working day. Within this short period of time eleven TNG software consultants were able to implement a prototype which is based on an Oculus Rift DK2 and an Intel RealSense F200 3D-camera. With some additional days and a core team of about six TNG software developers we were able to add some more features for the Augmented Rift.

Medium mjvkm9o8

Martin F. created project Augmented Rift

Medium e0baeabc 190c 4768 84a8 cf313e0b887d

Augmented Rift

The hardware hacking team from TNG Technology Consulting GmbH started to work on a device which is capable to do full field of view augmented reality in March 2015 when the company’s winter retreat was taking place.

The mobile “TNG Augmented Rift” is a full field of view Augmented Reality device capable to do e.g. face tracking, face identification, emotion detection, heart rate detection, distance measurements, etc. Speech recognition for command and control is implemented as well.

The goal was to build a device made with off-the-shelf hardware in one working day. Within this short period of time eleven TNG software consultants were able to implement a prototype which is based on an Oculus Rift DK2 and an Intel RealSense F200 3D-camera. With some additional days and a core team of about six TNG software developers we were able to add some more features for the Augmented Rift.

About

Intel Software Innovator, Intel Black Belt Software Developer, Oracle JavaOne Rock Star, Computer Scientist, Speaker, Technology, Musician, Traveller, Father of twins

Video

Featured Projects

See All

Thumb d992c31c eb92 47ba 8cce ad933dead3d0
  • Collaborators 1
  • Followers 8

Follow

ParrotAttacks

Thumb 300981 Thomas Endres

Created: 12/14/2015

Welcome to the game ParrotAttacks, a classical HTML5 browser based bird shooter game controlled b...

Bigger kt   whiteboard
  • Projects 2
  • Followers 114

Keith Temple

DX Strategist at Intel

Portland, OR, USA

Bigger bob duffy 3d head avatar
  • Projects 4
  • Followers 129

Bob Duffy

Folsom, CA, USA

Thumb cbf48b42 3a22 42f9 ba7a f12a631a3882
  • Collaborators 0
  • Followers 12

Follow

Parroteer

Thumb 300981 Thomas Endres

Created: 11/14/2015

Control a Parrot AR Drone quadrocopter using gesture control cameras like the Intel RealSense.

Thumb d992c31c eb92 47ba 8cce ad933dead3d0
  • Collaborators 1
  • Followers 8

Follow

ParrotAttacks

Thumb 300981 Thomas Endres

Created: 12/14/2015

Welcome to the game ParrotAttacks, a classical HTML5 browser based bird shooter game controlled b...

Thumb 9120fa2c 3e64 49a1 bdc6 9787c045ed9f
  • Collaborators 0
  • Followers 92

Follow

Space Mines

Thumb bob duffy 3d head avatar Bob Duffy

Created: 11/13/2015

Intel RealSense powered arcade game, controlled by using head and mouth

Medium android
Featured
  • Followers 1881

Android

Intel is inside more and more Android devices, and we have tools and resources to make your app d...

Medium big data
Featured
  • Followers 1947

Modern Code

Drive faster breakthroughs through faster code: Get more results on your hardware today and carry...

Medium morgan stanley 75 billion devices will be connected to the internet of things by 2020
Featured
  • Followers 1103

Internet of Things

Jumpstart your prototyping without reinventing the wheel. The Intel® IoT Developer Program provid...

Default user avatar 57012e2942
  • Projects 0
  • Followers 0

Ferdinand Jamitzky

PHD in Plasma Physics, Papers in Complex Systems Theory and Data Analytics

Boltzmannstraße 1, 85748 Garching bei München, Deutschland

Bigger bob duffy 3d head avatar
  • Projects 4
  • Followers 129

Bob Duffy

Folsom, CA, USA

Bigger anh fotosketcher
  • Projects 0
  • Followers 1

Trinh Yen

Hanoi, Hoàn Kiếm, Hanoi, Vietnam

See More