Spaces:
Runtime error
Bias towards certain voice types?
I'm in my 20's and believe myself to be a light tenor.
Some examples of light (or lyric tenor, not 100% sure) are Bruno mars, Justin Bieber, Justin Timberlake, Zayn,
Louis Tomlinson, bts members junkook, jim, jimin (higher tenor).
I did two runs and got completely different results talking higher or lower.
Adult Female 88%
Teen Male 10%
Adult Male 1%
Child (genderless) 1%
Teen Female
Adult Male 52%
Adult Female 40%
Teen Male 8%
Child (genderless) 0%
Teen Female
The only voice types where it should be almost impossible to tell male or female would be countertenor and contralto.
If you want to refine or make a new model I think using singers' voices might provide you a better framework.
Really great point! In our current use case for this model we're building confidence in the speakers voice over time until we've achieved a certain level of confidence. With some of the more "confusing" voices it takes a bit longer to converge to a confident guess.
Our hope is to use this model in the background so user's aren't motivated to try to trick it by changing the tone of their voice. It definitely falls for tricks like that.
Super interesting feedback though, perhaps we could try isolating vocals from songs and adding that into our training set.
Vocals from songs could be nice as there's more range, but maybe that should be left for the final refinement. Interviews of them speaking could be used before as well and they're probably quiet enough, althought would require more work than just throwing a bunch of acapellas.
Some interesting voices to train/test with I can think about are:
Dramatic mezzosoprano like Anastacia, that's a very heavy voice but clearly female.
Some contraltos with LIGHTER BUT more androginous tone are Annie Lenox and Cher, althought not all contraltos sound androginous when speaking, IMO Cher feels femenine.
A couple more which some people say to be contraltos and other consider deep mezzos (no androginous timbre when singing) are Tamar Braxton and Miley Cyrus.
I have no idea about any contratenor, but those light tenors should be enough, Adam Levine comes to mind as well, he sings nasally and in falsetto quite often, so that's a tricky one.