[PYTHON] [Dedicated to Telewa! ] PC operation with a webcam

~~ Actually, I made it long before the rise of Telewa. .. ~~

It's time for everyone to make an outstanding performance!

cam1.png

Introduction

Wouldn't it be nice if you could turn the screen when you're eating on the telewa and browsing the Web ** when both hands are closed ** ?? It's a burden on your wrist to bring your hand to the mouse every time. While leaning on the chair, if you raise your finger, you can switch tabs ...

It's graceful ... let's go to that DX!

Abstract

In summary, it's ** "Operation with shadow play" **.

handmouse.gif

Annotate the image you want to act on first.

1.png 2.png

Next, define the key input by mouse operation linked to the image in the config file. Then run the program and if it meets the OpenCV image similarity threshold, it will operate according to the definition.

code

I'm here, so please look at the repository for details.

Afterword

As long as there is a shape, it can be replaced with ** whatever ** operation.

pine.png

Is it okay to enter yoga poses and karate kata as a measure against lack of exercise? ~~ The work will never end! !! ~~

Hmm? Rather, is it an implementation suitable for people with some kind of physical handicap? ??

~~ I really wanted to implement it with tensorflow, but there is no GPU distributed by SIer, and real-time recognition is too far for PC. .. ~~

If you want to keep your hands on the keyboard, buy a 100% mirror as shown below and support analog! Lol

cam2.png

FYI

Similarity detection with Python ③ Feature point matching

NLPDev / HandGesture

Recommended Posts

[Dedicated to Telewa! ] PC operation with a webcam
Operate your PC with a webcam II. [Goodbye mouse! ]
Using a webcam with Raspberry Pi
Connect a commercially available webcam to a PC with ubuntu 16.04 installed via USB and capture video with python
How to add a package with PyCharm
[Easy] AI automatic recognition with a webcam!
How to make a dialogue system dedicated to beginners
How to read a CSV file with Python 2/3
Send a message to LINE with Python (LINE Notify)
How to send a message to LINE with curl
A memorandum to make WebDAV only with nginx
How to draw a 2-axis graph with pyplot
How to develop a cart app with Django
Try to draw a life curve with python
How to make a dictionary with a hierarchical structure.
Try to make a "cryptanalysis" cipher with Python
Pretend to be a server with two PCs
Decide to assign a laboratory with Python (fiction)
Steps to create a Twitter bot with python
Save the object to a file with pickle
Try to make a dihedral group with Python
How to create a multi-platform app with kivy
AWS Step Functions to learn with a sample
I want to write to a file with Python
A layman wants to get started with Python
Connect realsense D435 to a PC with ubuntu 16.04 installed and save depth videos with python
How to convert / restore a string with [] in python
A memo connected to HiveServer2 of EMR with python
[Python] How to draw a line graph with Matplotlib
I want to transition with a button in flask
Try to make a command standby tool with python
Python Ver. To introduce WebPay with a little code.
Try to dynamically create a Checkbutton with Python's Tkinter
I want to climb a mountain with reinforcement learning
Convert a text file with hexadecimal values to a binary file
I tried to draw a route map with Python
How to get a logged-in user with Django's forms.py
How to convert a class object to a dictionary with SQLAlchemy
How to make a shooting game with toio (Part 1)
[GCP] Try a sample to authenticate users with Firebase
Make a function to describe Japanese fonts with OpenCV
I want to work with a robot in python.
From buying a computer to running a program with python
I want to split a character string with hiragana
I tried to automatically generate a password with Python3
A sample to try Factorization Machines quickly with fastFM
I want to manually create a legend with matplotlib
A program to write Lattice Hinge with Rhinoceros with Python
Transit to the update screen with the Django a tag
[Python] How to create a 2D histogram with Matplotlib
Upload to a shared drive with Google Drive API V3
I want to run a quantum computer with Python
[Python] How to draw a scatter plot with Matplotlib
Apply conda's env to a specific directory with pyenv-vertualenv
Deploy a web app created with Streamlit to Heroku
[Python] Road to a snake charmer (5) Play with Matplotlib
I want to bind a local variable with lambda