top of page

HandGun

Design and Implementation of a new gesture for shooting for Intel Realsense Camera 

Introduction

Handgun is a First person shooter Game  which shows how we can move from clumsy mouse and keyboard controls in FPS to more intuitive control mechanisms using Intel's RealSense Technology.

​

In the game, the hand itself is used as a gun. Shape the hand into a gun and move it in the real world to aim inside the virtual world. Perform a well-known shooting gesture with the hand to shoot inside the game.

Design Process

Design Objective

Design an Interactive experience for Intel Realsense Camera making the best use of some or all of its capabilities.

Research

Research was carried out on the Intel Realsense Camera to understand

the technologies and its capabilities. Some of the research areas were:

  • A general understanding of the technology.

  • All of its capabilities

  • Supported modes and models of Interaction

  • Strengths and weaknesses

  • Target Devices it will be available on.

  • Existing Apps and Games on the technology.

The most important resorce for research was the device documentation , the SDK documentation and the Intel Developer Zone Community.

Concept Explorations

From the data gathered from research, several concepts were explored on paper based on offerings of the technologies. Demo users were asked to give feedback on the explored concepts.

Prototyping and User Testing

Based on the feedback of demo users on the concepts, one of the concepts was selected to be prototype, iterated on and developed.

Unity Game Engine was used to build rapid digital prototypes of the concepts and test the user experience. Based on playtest results, the base prototypes were rapidly iterated on and improved.

Implementation

Unity's 3d person survival shooter template was used to prototype and develop the new interaction.

Tools and Techniques Used

 

Unity 3D Game Engine

C# Programming Language

Intel RealSense SDK

 

 

Here is how the game works from behind

 

Once the user stretches her hands towards the screen , The RealSense front Facing Camera, the camera continuously captures its depth information and generates segmented images of the hands, and ignores the background.

 

Using the BlobExtractor function, the program detects the hand. From there, the center point of the hand, the top point, side points etc. are detected. The program uses these to recognize the shape. 

The center point of the hand is mapped to the virtual world coordinate and the game camera and gun are accordingly rotated.

 

The program continuously monitors for shape changes. If a shape change corresponds to the quick and sharp upward tilting of the hands, we know that a shot has been fired.A bullet shoots in the game.

bottom of page