Skip to main content

AirKey-3D hand gesture recognition

Page 1

AirKey

Interview "Teaching music is my passion, and I want to give my students the best possible education. But it's disheartening to see them struggle due to the lack of resources."

#Hands Gesture recognition #Arduino

" I love music, especially playing the piano, but it's so hard to pursue my passion here. I wish there was a way for me to learn and practice without the financial burden. " Davide. A music major graduate Demographics: Age: 22, Male, College student.

Emily. A music teacher

Individual project Hardware Design/UX Design

Pain Points

Demographics: Age 32, Female, Lives in a suburban area, Limited school budget School music teacher.

for music instruments Difficulty in engaging Goals: To make music education more accessible and students with varying engaging for her students, especially those who might find interest levels in music. traditional instruments intimidating or uninteresting.

YEAR:2022.12 - 2023.3

B

Pain Points

ackgrounds&Research

ack of Access: Limited access to musical instruments due to financial constraints and remote location Inadequate Music Programs: School's music program is underfunded, with few opportunities for hands-on learning. L

The gift of music belongs to everyone, yet many lack access to instruments that make learning possible. Between tight budgets and remote locations, children from poverty-striken communities in Asia are often barred from experiencing music's brilliance.

Expenditure

2000

79.5%

Hand Detection and Finger Counting Using OpenCV-Python

Ultrasonic Air Piano Hand Detection by 3D hand gesture recognition model

This tutorial extends the article on "Ultrasonic Parking Sensors" and utilizes the ultrasonic sensor of the micro:bit self-driving car (MoonCar Lunar Rover) to detect distances. These distances are then converted into piano scales, allowing for the playing of piano tunes through ultrasonic waves, essentially enabling the performance of piano melodies in the air.

TapID: Rapid Touch Interaction in Virtual Reality using Wearable Sensing

Convexity Convex Hull

Defect

500

Contour

B

Workshop

Communication and Coordination

udget vs Expenditure

ehman, P. R. (2020). A Look Ahead: Music Education from 2020 to 2050. Contributions to Music Education, 45, 67-80. Retrieved from ERIC - EJ1256014.

L

ack of Access: Limited access to musical instruments due to financial constraints and remote location Inadequate Music Programs: School's music program is underfunded, with few opportunities for hands-on learning. L

Inspiarions

1500

Resource Development

Disbursement of Funds

G

Pain Points

https://steam.oxxostudio.tw/category/microbit/mooncar/ultrasonic-piano.html

1000

The disbursement chart illustrates a prudent allocation of resources, with a significant portion of funds effectively utilized, ensuring the project's sustainability and impact.

oals: Look forward to the possibility of learning, creating, and sharing music without the need for expensive instruments.

oals: help students to overcome barriers and engage in music.

G

By importing Libraries- cv2 and numpy for handling arrays as well as for math, we can implement hand detection.

2500

Amount in USD

20.5%

Demographics: Age: 19, Female, graduate student.

9 M

Design Thoughts Budget

3000

Jia. A music major graduate

Ideation

Airkey is our vision to remove barriers to music education. Using hand gesture recognition, Air Piano gives users the power to produce beautiful piano melodies using just their hands and the air. Without expensive equipment required, Air Piano allows the joys of musical creation to exist anywhere.

The bubble chart reveals efficient budget management, with expenditures closely aligning with the planned budget, emphasizing our project's cost-effectiveness in delivering educational value.

piano tutor.

:

Difficulty in finding a clear path within the diverse music world Fear of complex music concepts and traditional instruments Limited access to musical resources, impacting exploration and growth.

G

"I've always dreamed of playing the piano."

I've always loved music, especially playing the piano, but it's so hard to pursue my passion here. I wish there was a way for me to learn and practice without the financial burden. Shen. A piano tutor Demographics Age 3 , ale, :

oals: Davide wants to enjoy his journey into music. He wants music to be a source of fun, creativity, and self-expression.

Pain Points

TapID, a wrist-based inertial sensing system that complements headset-tracked hand poses to trigger input in VR. TapID embeds a pair of inertial sensors in a flexible strap, one at either side of the wrist; from the combination of registered signals, TapID reliably detects surface touch events and, more importantly, identifies the finger used for touch. . eier, P. Streli, A. Fender and C. Holz, "TapID: Rapid Touch Interaction in Virtual Reality using Wearable Sensing," 2021 IEEE Virtual Reality and 3D User Inter faces (VR), Lisboa, Portugal, 2021, pp. 519-528, doi: 10.1109/VR50410.2021.00076. M M


Turn static files into dynamic content formats.

Create a flipbook