next »

[rogerlevy]

I am looking for something that can take a recording of me singing or humming or whistling and control a virtual instrument with that, by generating notes or a midi file or something, that matches fine pitch and volume changes too.  I use FL Studio, and I got the idea after trying out the Edison convert-audio-to-piano-roll feature.  I thought that it was funny how everything came out a little wrong, and I figured it was since they were trying to output raw flat midi notes, and I thought what if it just matched the pitch one-to-one with the original, and threw in volume matching too just for fun?  I'm hoping for a VST, but I'm open to at any plugin or program.  Does anyone know if something that does this exists?

Everyone knows what auto-tuning is, the (in?)famous pitch correcting effect that makes your voice sound computer-generated.  Well, basically I want to do the opposite of that.

[sergiocornaga]

Such a thing would be cool, and is of interest to me too.

[John Nesky]

I haven't used any such software, but it probably exists. It might not be free. It definitely won't be perfect.

The search term "onset detection" leads to some research on the topic...

[Epitaph64]

Well, in the past when people wanted that kind of effect, talk boxes and the like have been used. As far as particular software that can create an instrument from your voice and preserve all the fine pitch details, I sadly don't know of any.

[FranticPandaKev]

If you can get a hold of cubase 5, you can record vocals into that then using Vari-audio export it to a midi channel, after Vari-audio processes the audio you can control it like midi in the sample editor, so you can fix the pitch and tonality of wht your recording., then put it on a guitar on a midi channel.

[brog]

Antares Kantos?
It does exactly what you want and is awesome.  I can't seem to find it anywhere though - maybe they discontinued it?  That would be sad.

[Muz]

Lol, I wrote my thesis mostly on detecting and modifying the pitch and volume of someone's voice. I was thinking of probably write a proper free program that does it, but there's like, no motivation, and someone else would write a better one by the time I'm done. It's fully functional in MATLAB, just too lazy to convert to a proper application.

I could teach someone to do it if they want to do it themselves. Volume's quite trivial for a sound file, just square the sample. Trying to actually change volume in a sound file is a bit more complicated.

Pitch is a headache, none of the basic systems are that accurate, and you'd need a lot of experience to understand the more advanced ones (which aren't that accurate either). It's probably a lot easier if it's not speech, though, because speech has complicated sub-harmonics that screw up detection algorithms.

[XRA]

I've thought in the past that it would be cool to have something like that for quickly getting song ideas into rough midi form for composing, especially since I'm not much of a keyboard/piano player.

so I just searched around...haven't had a chance to try this right now, but they might be of some use (i'll try them later)

http://www.pluto.dti.ne.jp/~araki/amazingmidi/  <- freeware! has wav and midi sample

http://www.akoff.com/music-composer.html  <- trial cannot save midi file, has samples at bottom

http://www.mp3towav.org/TS-AudioToMIDI/

http://www.xitona.com/products/voicecomposer/describe.html

*edit* then there is Melodyne, which is probably the best thing out there that can do this
http://www.celemony.com/cms/index.php?id=product_comparison&L=0