A.I. Experiments:A.I. Duet
Hi, I am Yotam.
程序员 兼 音乐家
This is an experiment called ‘A.I. Duet’.
It uses machine learning to let you play a duet with the computer.
Making music using code isn’t a new thing at all.
The machine learning gives us a different way to go about it.
I was trying to make A.I. Duet with more traditional programming.
I have to write out lots of rules.
比如 如果有人打C 可能程序会上升到对G进行响应
Like if someone plays a ‘C’, maybe respond by going up to a ‘G’.
或者 如果有人按下了连续升高的三个音 结果有可能是降低的
Or if someone plays three sending notes, then maybe go back down.
I basically be creating this map to tell the computer how to make these decisions,
but there are just too many note and timing combinations to map it all by hand.
This experiment approaches the problem differently using machine learning.
Specifically neural networks.
We played the computer tons of examples of melodies.
Overtime, it learns these fuzzy relationships between notes and timing,
and build its own map based on the examples it’s being given.
So in this experiment, you play a few notes.
They go to the neural net,
which basically decides
based on those notes and all the examples it’s been given
some possible responses.
I had some friends tried out.
It was fun to see how it responds to different things people play.
It picks up on stuff
like key and rhythm that you’re implying.
Even though I never explicitly programmed in the concept key and rhythm.
It was cool to see people use it in ways I didn’t expect.
Instead of taking turns,
a few people played at the same time as they’re own that response.
Kind of getting in a creative feedback loop with the computer.
It’s also fun to just match the keyboard.
The neural network tries to return something coherent for many and what they give it.
I made all of the code open source,
and the neural network that I’m using is from Google’s open-source magenta project.
So anyone can grab it and train their own net.
I wanted to put this experiment out there.
Just as an example of the many kind of things
that you can make with machine learning and music.
And I’m really excited to see what other people do.
You can play it at ‘G.CO/AIEXPERIMENTS’.