Voice Acting by AI

Questions, skill improvement, and respectful critique involving music, sound, and movies.
Post Reply
User avatar
Posts: 63
Joined: Tue Aug 11, 2020 1:25 pm
Projects: A Night at the Office, Embracing Christmas, The Masquerade Benefit
Deviantart: HEXdidnt
Location: Harrow, London, UK

Voice Acting by AI

#1 Post by HEXdidnt »

One of the things I'm keen to add into my current project (and future projects, hopefully) is voice acting. However, I'm not currently in a position to commission a VA to speak the lines of one character, let alone all of them. Initially, I looked into self-voicing, but it appears as though that would use the system default voice for everything, with no option to switch voices on the fly, depending on which character is speaking.

As an experiment, I recorded myself as the 'narrator', just to get an idea of how to add voice tracks, but my voice just doesn't suit the female main character's internal dialogue. It was a fun process, certainly, but not much practical use. Over the weekend, I started looking into AI-generated voices as a stopgap, using Murf.ai, and now have a full set of narration and dialogue for my current work-in-progress demo.

It's... serviceable. The rhythm is better on some lines than others, the pronunciation relies on either choosing an established option (some of which just don't sound right to my ears) or attempting to decipher the custom pronunciation options, while adding emphasis became a real chore that seldom resulted in precisely what I was after. I certainly couldn't use it as a guide to direct a human VA, let alone in a 'finished product' VN, but it's 'good enough' as a proof of concept.

Has anyone else tried using AI to create voice tracks on a zero budget? If so, what were the results like... If not, why not?

What's the general consensus (if any!) on AI-generated voices, given that AI-generated art is widely considered pretty loathsome?
As ever, dropping litter in the zen garden of your mind...

User avatar
Posts: 31
Joined: Mon Oct 09, 2023 11:17 pm
Completed: "Love is War (Remake)", "Mahou Shoujo: Magical Shota", "Vampire Hunter", "How to Win Girls and Influence People", "Hayase Yuuka Love is War [Blue Archive Fangame]"
Projects: "DELIIDOL"
itch: rizvn

Re: Voice Acting by AI

#2 Post by RizVN »

AI or not, I think clumsy voice acting would only annoy the players. So I tend to stay away from adding VA to my game.
But voice synthesizer or voice banks such as Vocaloid are well received by some audiences, so the player bases themselves probably won't reject AI voice as much. Except for a minor resistance to change that people generally feel towards anything new.

The important thing is to make the voice acting good. I have tried using elevenlabs and play.ht default voices, but the results were way worse than expected.

You might want to try adding partial voices as a start. Such as only adding VA when characters' expressions changed, like in Danganronpa. Either way, I wish you well.
Check out these cute games:
Love is War (Remake) (Romance-comedy)
How to Win Girls and Influence People (Romance-comedy)
DELIIDOL (Romance-drama)
Mahou Shoujo: Magical Shota (Romance-drama)

Posts: 1
Joined: Mon Jul 08, 2024 6:31 am

Re: Voice Acting by AI

#3 Post by DerHarry »

Are you still interessted in this?

I would like to make a more generic version of this: https://github.com/lugia19/renpyDialogToAudio

This is using elevenlabs.

Ping me if you want to help.

Post Reply

Who is online

Users browsing this forum: No registered users