Real Time Virtual Human Hand Using Leap Motion Controller


  • R. Sastheeshkumar annamalai university
  • R. Arivoli Annamalai University


the research of robotics needs a good and accurate control. The proposed concept is touch less and non-verbal communication with the use of leap motion controller. The concept has two major parts: first part is “device perceive hand finger moments and send signal”, second part is robotic hand interfaced with PIC microcontroller which receives signal and controls robotic hand. The paper aims to link virtual environment with real time environment. The virtual environment is consisting of leap motion controller and laptop, real time environment is consisting of microcontroller and robotic arm. In real time environment parodist is converts into virtual environment.

Author Biography

R. Arivoli, Annamalai University

Professor (Retired)
Department of Electrical Engineering


Saudabayev A, Varol HA. Sensors for robotic hands: A survey of state of

the art. IEEE Access. 2015;3:1765-82.

Kofman J, Wu X, Luu TJ, Verma S. Teleoperation of a robot manipulator using a vision-based human-robot interface. IEEE

transactions on industrial electronics. 2005 Oct;52(5):1206-19.

Chu NS, Tai CL. Real-time painting with an expressive virtual Chinese

brush. IEEE Computer Graphics and applications. 2004 Sep;24(5):76-85.

Kruse D, Wen JT, Radke RJ. A sensor-based dual-arm tele-robotic system. IEEE Transactions on Automation Science and Engineering.


Jiang H, Duerstock BS, Wachs JP. A machine vision-based gestural interface for people with upper extremity physical impairments. IEEE Transactions on Systems, Man, and Cybernetics: Systems. 2013 Aug


Elons AS, Ahmed M, Shedid H, Tolba MF. Arabic sign language recognition using leap motion sensor. In2014 9th International Conference on Computer Engineering & Systems (ICCES) 2014 Dec 22

(pp. 368-373). IEEE.

Hirche S, Buss M. Human-oriented control for haptic teleoperation

Proceedings of the IEEE. 2012 Mar;100(3):623-47.

Vamsikrishna KM, Dogra DP, Desarkar MS. Computer-vision-assisted palm rehabilitation with supervised learning. IEEE Transactions on

Biomedical Engineering. 2016 May;63(5):991-1001.

Ponraj G, Ren H. Sensor Fusion of Leap Motion Controller and Flex Sensors Using Kalman Filter for Human Finger Tracking. IEEE Sensors

Journal. 2018 Mar 1;18(5):2042-9.

Aditya K, Chacko P, Kumari D, Kumari D, Bilgaiyan S. Recent Trends in HCI: A survey on Data Glove, LEAP Motion and Microsoft Kinect.In2018 IEEE International Conference on System, Computation,

Automation and Networking (ICSCA) 2018 Jul 6 (pp. 1-5). IEEE.

Mitra S, Acharya T. Gesture recognition: A survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).


Waldherr S, Romero R, Thrun S. A gesture based interface for human-

robot interaction. Autonomous Robots. 2000 Sep 1;9(2):151-73.

Marin G, Dominio F, Zanuttigh P. Hand gesture recognition with leap motion and kinect devices. In2014 IEEE International Conference on

Image Processing (ICIP) 2014 Oct 27 (pp. 1565-1569). IEEE.

Sarkar A, Patel KA, Ram RG, Capoor GK. Gesture control of drone using a motion controller. In2016 International Conference on Industrial Informatics and Computer Systems (CIICS) 2016 Mar 13 (pp. 1-5).


R.Satheeshkumar and R. Arivoli , ” Real Time Virtual Human Hand For

Robotics.”82-89.Journal of Computational Information Systems 15.1 (2019):

R.Satheeshkumar and R. Arivoli , "Real Time Virtual Human Hand for Diagnostic Robot (DiagBot) Arm Using IOT “Journal of advanced research in dynamical and control system, Vol. 12, 01-Special Issue, 2020.

R.Satheeshkumar and R. Arivoli , "Real Time Robotic Arm Control Using Human Hand Gesture Measurement “ Journal of advanced research in dynamical and control system, Vol. 12, 04-Special Issue, 2020.

R.Satheeshkumar and R. Arivoli, "IOT Integrated Virtual Hand for Robotic Arm Using Leap Motion Controller" The Journal of Research on the Lepidoptera, Vol. 12, 04-Special Issue, 2020.






Control, Automation and Robotics