Screen Shot 2020-10-13 at 23.33.34.png

DEEP KARAOKE • exploring machine learning through song

640600bb-8e23-4c0c-9fc7-13c03057d35c.jpg

DEEP KARAOKE

Exploring Machine Learning with Song

 
 

What: Experience Prototyping Machine Learning Course
Duration: 3 days, winter 2019
With: Ivan Kunjavic, Toby Whelan, Yijiia Tao, Lea Bachmann
Skills: Teachable Machine, P5.js, Runway GPT-2

 

OVERVIEW

During our experience prototyping course, we worked on creating a karaoke machine which utilises machine learning to generate new lyrics and music videos for a new twist on the karaoke experience. Using Teachable Machine and the GPT2 pre trained model through Runway, we create an interaction with a cube with album covers on it with which the user can select a song. Using GPT2 the karaoke machine then generates alternative lyrics to karaoke classics!

 
 

SONG SELECTION

Select the song using the album cover cube

choosing the song.gif
Deep Karaoke Giffs.gif

BECOME THE POPSTAR

Deep Karaoke, generates new lyrics to your favourite songs and immerses you inside the video so you can really be the the popstar!

IMG_3425%2B%25281%2529.jpg
Deep Karaoke Giffs_6.gif