Real-time hand pose estimation and gesture classification using TensorRT

this project implements the hand gesture recognition algorithm introduced in paper online detection and classification of dynamic hand gestures with recurrent 3d convolutional neural networks

A custom sEMG dataset developed with the Myo Armband for hand gesture classification

A lightweight CNN-Transformer model for classification of hand gestures from trans-radial surface electromyography signals (sEMG).

A powerful real-time AI-driven hand gesture recognition and game control system built using OpenCV, MediaPipe, PyAutoGUI, and custom gesture-classification algorithms. This project enables users to control PC games using hand gestures, removing the need for a keyboard or controller.

ROS2 package for trt_pos_hand, "Real-time hand pose estimation and gesture classification using TensorRT"

A system to recognize hand gestures by applying feature extraction, feature selection (PCA) and classification (SVM, decision tree, Neural Network) on the raw data captured by the sensors while performing the gestures.

An application to control media player from distance using hand gestures. It was developed by creating a hand gestures dataset using OpenCV, building a 2D CNN model for feature extraction and classification, and integrating the Keyboard keys to hand gestures using the PyAutoGUI library. whenever a gesture is predicted, the corresponding action is performed on the Media Player. Also, created a user interface using the Streamlit web framework and deployed source files with demo using streamlit.io sharing.

The project aims at building a machine learning model that will be able to classify the various hand gestures used for fingerspelling in sign language. In this user independent model, classification machine learning algorithms are trained using a set of image data and testing is done. Various machine learning algorithms are applied on the datasets, including Convolutional Neural Network (CNN).

Artificial Intelligence and Machine Learning have empowered our lives to a large extent. The number of advancements made in this space has revolutionized our society and continue making society a better place to live in. In terms of perception, both Artificial Intelligence and Machine Learning are often used in the same context which leads to confusion. AI is the concept in which machine makes smart decisions whereas Machine Learning is a sub-field of AI which makes decisions while learning patterns from the input data. In this blog, we would dissect each term and understand how Artificial Intelligence and Machine Learning are related to each other. What is Artificial Intelligence? The term Artificial Intelligence was recognized first in the year 1956 by John Mccarthy in an AI conference. In layman terms, Artificial Intelligence is about creating intelligent machines which could perform human-like actions. AI is not a modern-day phenomenon. In fact, it has been around since the advent of computers. The only thing that has changed is how we perceive AI and define its applications in the present world. The exponential growth of AI in the last decade or so has affected every sphere of our lives. Starting from a simple google search which gives the best results of a query to the creation of Siri or Alexa, one of the significant breakthroughs of the 21st century is Artificial Intelligence. The Four types of Artificial Intelligence are:- Reactive AI – This type of AI lacks historical data to perform actions, and completely reacts to a certain action taken at the moment. It works on the principle of Deep Reinforcement learning where a prize is awarded for any successful action and penalized vice versa. Google’s AlphaGo defeated experts in Go using this approach. Limited Memory – In the case of the limited memory, the past data is kept on adding to the memory. For example, in the case of selecting the best restaurant, the past locations would be taken into account and would be suggested accordingly. Theory of Mind – Such type of AI is yet to be built as it involves dealing with human emotions, and psychology. Face and gesture detection comes close but nothing advanced enough to understand human emotions. Self-Aware – This is the future advancement of AI which could configure self-representations. The machines could be conscious, and super-intelligent. Two of the most common usage of AI is in the field of Computer Vision, and Natural Language Processing. Computer Vision is the study of identifying objects such as Face Recognition, Real-time object detection, and so on. Detection of such movements could go a long way in analyzing the sentiments conveyed by a human being. Natural Language Processing, on the other hand, deals with textual data to extract insights or sentiments from it. From ChatBot Development to Speech Recognition like Amazon’s Alexa or Apple’s Siri all uses Natural Language to extract relevant meaning from the data. It is one of the widely popular fields of AI which has found its usefulness in every organization. One other application of AI which has gained popularity in recent times is the self-driving cars. It uses reinforcement learning technique to learn its best moves and identify the restrictions or blockage in front of the road. Many automobile companies are gradually adopting the concept of self-driving cars. What is Machine Learning? Machine Learning is a state-of-the-art subset of Artificial Intelligence which let machines learn from past data, and make accurate predictions. Machine Learning has been around for decades, and the first ML application that got popular was the Email Spam Filter Classification. The system is trained with a set of emails labeled as ‘spam’ and ‘not spam’ known as the training instance. Then a new set of unknown emails is fed to the trained system which then categorizes it as ‘spam’ or ‘not spam.’ All these predictions are made by a certain group of Regression, and Classification algorithms like – Linear Regression, Logistic Regression, Decision Tree, Random Forest, XGBoost, and so on. The usability of these algorithms varies based on the problem statement and the data set in operation. Along with these basic algorithms, a sub-field of Machine Learning which has gained immense popularity in recent times is Deep Learning. However, Deep Learning requires enormous computational power and works best with a massive amount of data. It uses neural networks whose architecture is similar to the human brain. Machine Learning could be subdivided into three categories – Supervised Learning – In supervised learning problems, both the input feature and the corresponding target variable is present in the dataset. Unsupervised Learning – The dataset is not labeled in an unsupervised learning problem i.e., only the input features are present, but not the target variable. The algorithms need to find out the separate clusters in the dataset based on certain patterns. Reinforcement Learning – In this type of problems, the learner is rewarded with a prize for every correct move, and penalized for every incorrect move. The application of Machine Learning is diversified in various domains like Banking, Healthcare, Retail, etc. One of the use cases in the banking industry is predicting the probability of credit loan default by a borrower given its past transactions, credit history, debt ratio, annual income, and so on. In Healthcare, Machine Learning is often been used to predict patient’s stay in the hospital, the likelihood of occurrence of a disease, identifying abnormal patterns in the cell, etc. Many software companies have incorporated Machine Learning in their workflow to steadfast the process of testing. Various manual, repetitive tasks are being replaced by machine learning models. Comparison Between AI and Machine Learning Machine Learning is the subset of Artificial Intelligence which has taken the advancement in AI to a whole new level. The thought behind letting the computer learn from themselves and voluminous data that are getting generated from various sources in the present world has led to the emergence of Machine Learning. In Machine Learning, the concept of neural networks plays a significant role in allowing the system to learn from themselves as well as maintaining its speed, and accuracy. The group of neural nets lets a model rectifying its prior decision and make a more accurate prediction next time. Artificial Intelligence is about acquiring knowledge and applying them to ensure success instead of accuracy. It makes the computer intelligent to make smart decisions on its own akin to the decisions made by a human being. The more complex the problem is, the better it is for AI to solve the complexity. On the other hand, Machine Learning is mostly about acquiring knowledge and maintaining better accuracy instead of success. The primary aim is to learn from the data to automate specific tasks. The possibilities around Machine Learning and Neural Networks are endless. A set of sentiments could be understood from raw text. A machine learning application could also listen to music, and even play a piece of appropriate music based on a person’s mood. NLP, a field of AI which has made some ground-breaking innovations in recent years uses Machine Learning to understand the nuances in natural language and learn to respond accordingly. Different sectors like banking, healthcare, manufacturing, etc., are reaping the benefits of Artificial Intelligence, particularly Machine Learning. Several tedious tasks are getting automated through ML which saves both time and money. Machine Learning has been sold these days consistently by marketers even before it has reached its full potential. AI could be seen as something of the old by the marketers who believe Machine Learning is the Holy Grail in the field of analytics. The future is not far when we would see human-like AI. The rapid advancement in technology has taken us closer than ever before to inevitability. The recent progress in the working AI is much down to how Machine Learning operates. Both Artificial Intelligence and Machine Learning has its own business applications and its usage is completely dependent on the requirements of an organization. AI is an age-old concept with Machine Learning picking up the pace in recent times. Companies like TCS, Infosys are yet to unleash the full potential of Machine Learning and trying to incorporate ML in their applications to keep pace with the rapidly growing Analytics space. Conclusion The hype around Artificial Intelligence and Machine Learning are such that various companies and even individuals want to master the skills without even knowing the difference between the two. Often both the terms are misused in the same context. To master Machine Learning, one needs to have a natural intuition about the data, ask the right questions, and find out the correct algorithms to use to build a model. It often doesn’t requiem how computational capacity. On the other hand, AI is about building intelligent systems which require advanced tools and techniques and often used in big companies like Google, Facebook, etc. There is a whole host of resources to master Machine Learning and AI. The Data Science blogs of Dimensionless is a good place to start with. Also, There are Online Data Science Courses which cover the various nitty gritty of Machine Learning.

Electromyography (EMG) based convolutional neural network for hand gesture classification.

Hands-on computer vision projects exploring face recognition, object tracking, digit classification, and gesture detection using Python and OpenCV.

Real-time ASL interpreter using OpenCV and TensorFlow/Keras for hand gesture recognition. Features custom hand tracking, image preprocessing, and gesture classification to translate American Sign Language into text and speech output. Built with accessibility in mind.

A simple hand gesture recognition algorithm using tensorflow and mediapipe

Sign Language Recognition using 2D CNN + LSTM on a subset of the WLASL dataset. This project extracts hand landmarks with MediaPipe, processes video data, and trains a spatiotemporal deep learning model for gesture classification.

Hand gesture classification by optomyographical sensor signals

Hand-Gesture Classification using various Machine Learning Models

No description available

No description available

EMG Hand Gestures Classification using a variety of classifiers

Gesture Hero is a hand gesture classification system that's build to differentiate between hand gestures representing numbers from 0-5.

No description available

A computer vision-based sign language recognition system using MediaPipe and neural networks to classify static and dynamic hand gestures for real-time applications.

Repository containing code and models for the paper "3D dynamic interaction in virtual reality environments by hand gesture recognition"

Repository containing the datasets for the paper "3D dynamic interaction in virtual reality environments by hand gesture recognition"

A robotic hand controlled by EMG(Electromyogram)-based hand recognition

HGC is a Hand Gesture Control Module based on Google's Mediapipe and a custom model build on top of it for gesture classification.

MyoClassifier: A real-time hand gesture classification system using EMG/IMU data from the Myo Armband. Leverages machine learning and Pyomyo for signal processing, controlling a 3D Unity hand model.

Goal: To develop an intelligent system capable of converting hand gestures (American Sign Language) into audio output in real time, utilizing computation power of smart phones and unobtrusive (wear and forget) wearable technology. Description: The aim is to support people with partial or total speech impairment and elderly citizens with speech or motor impairment with a medium to interact with smart devices. The idea is to use gesture classification using Hidden Markov Models, LSTM or Bayes linear classifier for classifying gestures (Sign language gestures) and using Mary Text to Speech by DFKI to convert the classified gesture into speech.

Hand Gestures - Classification with Object Detection. Used Residual and Inception-v4 deep neural networks along with Single shot multibox detector neural net. Used Tensorflow and Keras.