Jump to content
The Dark Mod Forums

xVASynth v2


Zerg Rush

Recommended Posts

xVASynth is an AI tool for generating high-quality voice acting lines using voices from video games. With hundreds of voices supported, across dozens of games, the app provides pitch, duration, and energy control at per-letter granularity.

 

adinHBk.png

The use of neural speech synthesis leads to natural sounding voices, something which is very difficult to do with more traditional methods involving concatenations of existing data. It also means new vocabulary can be generated, outside of what the voice actors have already read out.

OpenSource and free

https://github.com/DanRuta/xVA-Synth

https://store.steampowered.com/app/1765720/xVASynth_v2/

Widows 10

GPU 2 Gb, (if use GPU mode)

HD 10Gb

 

  • Like 2

Sys Specs Laptop Lenovo V145 15AST, AMD A9- 9425 Radeon R5 - 5 cores 3,1 GHz  RAM 8Gb, GPU 1+2 Gb -Win10 64 v21H2

Favorite online apps you may like too 😉

Link to comment
Share on other sites

Wel, it should work also for windows 11 or older.  Just try it. It is free. (Its developed using python. So  it can be ported to older or other os'ses)

Wow, thats a nice app. After looking at some demo videos.

But what are audio rights, when using it for TDM?

Demo video:

 

Edited by freyk
  • Like 1

Info: My portfolio and darkmod graphical installer
Amnesty for Bikerdude!

Link to comment
Share on other sites

5 hours ago, datiswous said:

Cool, so I can take voices from TDM to create new voice lines for in TDM. 😬

Yes, but as you can see in the demos, even big videogame characters like C&C:s Kane, with lots of voice data, produce fairly choppy lines. If the TDM lines fail, try basing them off of Troy Baker instead, or (for the protagonist) Stephen L. Russell and (for Benny the guard) Daniel Thron.

Link to comment
Share on other sites

I'm sure that Mohammed wouldn't like his work to be defiled or burned either, but that typically falls under free artistic expression. Famous people have been exploited in this way since way before deepfakes came along - pretty much since idol posters were a thing.

Sorry.

Link to comment
Share on other sites

I have put this app, because I think that not everyone here has easy access to a voice actor to create dialogue for the missions they create, this is a viable alternative. There is no infringement of possible copyright violations, since, unlike Deep Fake, the original voices are modified, changing tones and adapting it to the text. The AI is only based on one or more of the chosen voices.
This is more similar in voices to what ArtBreeder does with images, not DeepFake.

  • Like 2

Sys Specs Laptop Lenovo V145 15AST, AMD A9- 9425 Radeon R5 - 5 cores 3,1 GHz  RAM 8Gb, GPU 1+2 Gb -Win10 64 v21H2

Favorite online apps you may like too 😉

Link to comment
Share on other sites

I spoke to Dan about this, and he did say, if someone could provide him with the text of Thiefs vocalisations, he'd be happy to include Thief in the VaSynth.  

I have an eclectic YouTube channel making videos on a variety of games. Come and have look here:

https://www.youtube.com/c/NeonsStyleHD

 

Dark Mod Missions: Briarwood Manor - available here or in game

http://forums.thedarkmod.com/topic/18980-fan-mission-briarwood-manor-by-neonsstyle-first-mission-6082017-update-16/

 

 

Link to comment
Share on other sites

40 minutes ago, NeonsStyle said:

I spoke to Dan about this, and he did say, if someone could provide him with the text of Thiefs vocalisations, he'd be happy to include Thief in the VaSynth.  

...and with "vocalisation" I'm assuming that you mean just all the samples from the game, and not some special studio format of them.

Link to comment
Share on other sites

About making templates: I've gone over some recent AI voice synthesizers, and one of them requires the voice actor to read a specific long text provided by the program. That sounds like a very thorough way to make a template, if they're willing to do that, which would probably produce good results. I can't remember what synthesizer required that, though. I'm just describing what "making a template" could entail.

Edited by Nort
Link to comment
Share on other sites

On 6/14/2022 at 3:51 PM, Nort said:

...and with "vocalisation" I'm assuming that you mean just all the samples from the game, and not some special studio format of them.

He means the transscript of what the game characters say along with the voice files to train the AI. He doesn't use a games actual files other than to listen to to get the AI to sound right. 

I have an eclectic YouTube channel making videos on a variety of games. Come and have look here:

https://www.youtube.com/c/NeonsStyleHD

 

Dark Mod Missions: Briarwood Manor - available here or in game

http://forums.thedarkmod.com/topic/18980-fan-mission-briarwood-manor-by-neonsstyle-first-mission-6082017-update-16/

 

 

Link to comment
Share on other sites

  • 2 weeks later...
On 6/11/2022 at 2:06 PM, freyk said:

Demo video:

The voices are still in the uncanny valley. But they definitely aren't sounding as monotonic and glitchy as in the ole Microsoft Sam times...

It should be possible to get a sortof good sounding voice when feeding it with some weeks worth of audio books or youtube videos featuring only one speaker and no background noise.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Recent Status Updates

    • Ansome

      Turns out my 15th anniversary mission idea has already been done once or twice before! I've been beaten to the punch once again, but I suppose that's to be expected when there's over 170 FMs out there, eh? I'm not complaining though, I love learning new tricks and taking inspiration from past FMs. Best of luck on your own fan missions!
      · 4 replies
    • The Black Arrow

      I wanna play Doom 3, but fhDoom has much better features than dhewm3, yet fhDoom is old, outdated and probably not supported. Damn!
      Makes me think that TDM engine for Doom 3 itself would actually be perfect.
      · 6 replies
    • Petike the Taffer

      Maybe a bit of advice ? In the FM series I'm preparing, the two main characters have the given names Toby and Agnes (it's the protagonist and deuteragonist, respectively), I've been toying with the idea of giving them family names as well, since many of the FM series have named protagonists who have surnames. Toby's from a family who were usually farriers, though he eventually wound up working as a cobbler (this serves as a daylight "front" for his night time thieving). Would it make sense if the man's popularly accepted family name was Farrier ? It's an existing, though less common English surname, and it directly refers to the profession practiced by his relatives. Your suggestions ?
      · 9 replies
    • nbohr1more

      Looks like the "Reverse April Fools" releases were too well hidden. Darkfate still hasn't acknowledge all the new releases. Did you play any of the new April Fools missions?
      · 5 replies
    • The Black Arrow

      Hope everyone has the blessing of undying motivation for "The Dark Mod 15th Anniversary Contest". Can't wait to see the many magnificent missions you all may have planned. Good luck, with an Ace!
      · 0 replies
×
×
  • Create New...