Jump to content
The Dark Mod Forums

xVASynth v2


Zerg Rush
 Share

Recommended Posts

xVASynth is an AI tool for generating high-quality voice acting lines using voices from video games. With hundreds of voices supported, across dozens of games, the app provides pitch, duration, and energy control at per-letter granularity.

 

adinHBk.png

The use of neural speech synthesis leads to natural sounding voices, something which is very difficult to do with more traditional methods involving concatenations of existing data. It also means new vocabulary can be generated, outside of what the voice actors have already read out.

OpenSource and free

https://github.com/DanRuta/xVA-Synth

https://store.steampowered.com/app/1765720/xVASynth_v2/

Widows 10

GPU 2 Gb, (if use GPU mode)

HD 10Gb

 

  • Like 2

Sys Specs Laptop Lenovo V145 15AST, AMD A9- 9425 Radeon R5 - 5 cores 3,1 GHz  RAM 8Gb, GPU 1+2 Gb -Win10 64 v21H2

Favorite online apps you may like too 😉

Link to comment
Share on other sites

Wel, it should work also for windows 11 or older.  Just try it. It is free. (Its developed using python. So  it can be ported to older or other os'ses)

Wow, thats a nice app. After looking at some demo videos.

But what are audio rights, when using it for TDM?

Demo video:

 

Edited by freyk
  • Like 1

Info: My portfolio and darkmod graphical installer
Amnesty for Bikerdude!

Link to comment
Share on other sites

I already looked into it, and they got it to work on a Windows 7 virtual machine, at which point I just give up. It looks great, but personally I'm not that passionate that I'm going to install virtual OS:es.

Link to comment
Share on other sites

5 hours ago, datiswous said:

Cool, so I can take voices from TDM to create new voice lines for in TDM. 😬

Yes, but as you can see in the demos, even big videogame characters like C&C:s Kane, with lots of voice data, produce fairly choppy lines. If the TDM lines fail, try basing them off of Troy Baker instead, or (for the protagonist) Stephen L. Russell and (for Benny the guard) Daniel Thron.

Link to comment
Share on other sites

I'm sure that Mohammed wouldn't like his work to be defiled or burned either, but that typically falls under free artistic expression. Famous people have been exploited in this way since way before deepfakes came along - pretty much since idol posters were a thing.

Sorry.

Link to comment
Share on other sites

I have put this app, because I think that not everyone here has easy access to a voice actor to create dialogue for the missions they create, this is a viable alternative. There is no infringement of possible copyright violations, since, unlike Deep Fake, the original voices are modified, changing tones and adapting it to the text. The AI is only based on one or more of the chosen voices.
This is more similar in voices to what ArtBreeder does with images, not DeepFake.

  • Like 2

Sys Specs Laptop Lenovo V145 15AST, AMD A9- 9425 Radeon R5 - 5 cores 3,1 GHz  RAM 8Gb, GPU 1+2 Gb -Win10 64 v21H2

Favorite online apps you may like too 😉

Link to comment
Share on other sites

I spoke to Dan about this, and he did say, if someone could provide him with the text of Thiefs vocalisations, he'd be happy to include Thief in the VaSynth.  

I have an eclectic YouTube channel making videos on a variety of games. Come and have look here:

https://www.youtube.com/c/NeonsStyleHD

 

Dark Mod Missions: Briarwood Manor - available here or in game

http://forums.thedarkmod.com/topic/18980-fan-mission-briarwood-manor-by-neonsstyle-first-mission-6082017-update-16/

 

 

Link to comment
Share on other sites

40 minutes ago, NeonsStyle said:

I spoke to Dan about this, and he did say, if someone could provide him with the text of Thiefs vocalisations, he'd be happy to include Thief in the VaSynth.  

...and with "vocalisation" I'm assuming that you mean just all the samples from the game, and not some special studio format of them.

Link to comment
Share on other sites

About making templates: I've gone over some recent AI voice synthesizers, and one of them requires the voice actor to read a specific long text provided by the program. That sounds like a very thorough way to make a template, if they're willing to do that, which would probably produce good results. I can't remember what synthesizer required that, though. I'm just describing what "making a template" could entail.

Edited by Nort
Link to comment
Share on other sites

On 6/14/2022 at 3:51 PM, Nort said:

...and with "vocalisation" I'm assuming that you mean just all the samples from the game, and not some special studio format of them.

He means the transscript of what the game characters say along with the voice files to train the AI. He doesn't use a games actual files other than to listen to to get the AI to sound right. 

I have an eclectic YouTube channel making videos on a variety of games. Come and have look here:

https://www.youtube.com/c/NeonsStyleHD

 

Dark Mod Missions: Briarwood Manor - available here or in game

http://forums.thedarkmod.com/topic/18980-fan-mission-briarwood-manor-by-neonsstyle-first-mission-6082017-update-16/

 

 

Link to comment
Share on other sites

  • 2 weeks later...
On 6/11/2022 at 2:06 PM, freyk said:

Demo video:

The voices are still in the uncanny valley. But they definitely aren't sounding as monotonic and glitchy as in the ole Microsoft Sam times...

It should be possible to get a sortof good sounding voice when feeding it with some weeks worth of audio books or youtube videos featuring only one speaker and no background noise.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

 Share

  • Recent Status Updates

    • STiFU

      Anyone here clocking in some times in Neon Light?
      · 0 replies
    • JackFarmer

      Boris Johnson's resignation does not change the fact that Australia is home to 29 million kangaroos and Wales has a population of just over three million.

      If the Australian kangaroos were to invade Wales, one resident would have to fight almost ten kangaroos at a time.
      · 8 replies
    • peter_spy

      Deathloop – what a mess of a game. I'd love to see a post-mortem on it some day. I hope Arkane is doing okay though.
      · 27 replies
    • OrbWeaver

      I like house-cleaning and taking out the trash.
      · 3 replies
    • STiFU

      Be honest: Who of you have actually finished Cuphead? This game is freaking tough! It might even be harder than Sekiro. Dark Souls is a joke in comparison to Cuphead! :-D 
      · 8 replies
×
×
  • Create New...