Sorry your browser is not supported!

You are using an outdated browser that does not support modern web technologies, in order to use this site please update to a new browser.

Browsers supported include Chrome, FireFox, Safari, Opera, Internet Explorer 10+ or Microsoft Edge.

DarkBASIC Professional Discussion / Dark Voices

Author
Message
Richard Davey
Retired Moderator
22
Years of Service
User Offline
Joined: 30th Apr 2002
Location: On the Jupiter Probe
Posted: 27th Feb 2006 20:11 Edited at: 27th Feb 2006 20:12
Link
Hi all,



We released a new product today - Dark Voices. This is a lip-sync tool for DBPro. It will allow you to load (or record) a WAV file and will then analyse it and create a set of lip-sync data based on the speech within. You can fine-tune this using the editor and export the lip sync files. Example DBPro code is included to show how to use it, the full source code to the editor itself is included, and there is a 3DS Max model of a nicely built 3D head, with all the correct mouth positions for each phoneme.

Watch the videos online, or download the 55MB demo (Warning: Requires Feb. 2006 DirectX build, follow the instructions on the web page first).

More here: http://darkbasicpro.thegamecreators.com/?f=dark_voices

Cheers,

Rich

Bite my shiny metal ass

Attachments

Login to view attachments
Back to top
Profile PM Email Website
Chris Franklin
18
Years of Service
User Offline
Joined: 2nd Aug 2005
Location: UK
Posted: 27th Feb 2006 20:30
Link
Cool i might buy this for my next project

Theme park simulator wip
http://forum.thegamecreators.com/?m=forum_view&t=71731&b=8
Back to top
Profile PM Website
Kenjar
18
Years of Service
User Offline
Joined: 17th Jun 2005
Location: TGC
Posted: 27th Feb 2006 20:45
Link
If you are going to sell it, a pack of human and humanoid models and textures with source files (pref editable with milkshape 3d) for easy alternation of base models designed to work with the plugin. I assume the plugin uses specific references to vertex's or model groups.

Back to top
Profile PM Email Website
Habatar
19
Years of Service
User Offline
Joined: 9th Aug 2004
Location: Madrid (Spain)
Posted: 27th Feb 2006 20:54
Link
This is very impressive and very realistic.
Back to top
Profile PM Email
Ron Erickson
Moderator
21
Years of Service
User Offline
Joined: 6th Dec 2002
Location: Pittsburgh, PA, USA
Posted: 27th Feb 2006 20:57 Edited at: 27th Feb 2006 20:58
Link
Quote: "If you are going to sell it, a pack of human and humanoid models and textures with source files (pref editable with milkshape 3d) for easy alternation of base models designed to work with the plugin. I assume the plugin uses specific references to vertex's or model groups."


Well, they supply a head model with it and give tutorials for setting up your own. I don't imagine it actually uses vertex manipulation to perform the lip movement. I would guess that you justneed to add a couple more bones to your model to control the lips for it to work properly.
I'll have to see if I can get it working with my EZactor characters. It's only one more thing on the list to do

EZrotate!
TextureMax!
EZactor!
Back to top
Profile PM Email
BatVink
Moderator
21
Years of Service
User Offline
Joined: 4th Apr 2003
Location: Gods own County, UK
Posted: 27th Feb 2006 22:22
Link
Quote: "I don't imagine it actually uses vertex manipulation to perform the lip movement. I would guess that you justneed to add a couple more bones to your model to control the lips for it to work properly."


The phonemes are all points in the animation, but if you look at the code each "pose" is interpolated to the next. So she is, as near as damn it, talking like a real human would.

The speech and the model are separate entities, so with a little imagination you could apply the tool in whatever way suits you

Back to top
Profile PM Email
Drew the G
User Banned
Posted: 27th Feb 2006 22:24
Link
Wow, I am totally using this after I finish the Schmup Compo, great stuff Rich.

Arr
Back to top
Profile
Benjamin
21
Years of Service
User Offline
Joined: 24th Nov 2002
Location: France
Posted: 28th Feb 2006 00:47
Link
The download link for the demo seems broken. I just get a "Bad Request (Invalid Hostname)" page.

Tempest - P2P UDP Multiplayer Plugin - 70%
Back to top
Profile PM Email
FINN MAN
20
Years of Service
User Offline
Joined: 2nd May 2004
Location:
Posted: 28th Feb 2006 01:05
Link
this is very cool, I might buy this.
Back to top
Profile PM Email
FINN MAN
20
Years of Service
User Offline
Joined: 2nd May 2004
Location:
Posted: 28th Feb 2006 01:06
Link
when I tryed to download the file, it asked me for a user name and password.
Back to top
Profile PM Email
Sunflash
18
Years of Service
User Offline
Joined: 28th Jun 2005
Location: Seattle, Wa
Posted: 28th Feb 2006 01:14
Link
Wow, this would be swwet for my project I'm working on. To bad I'm useing DBC, I needed to animate a person talking A LOT! Thios would really help. Oh well. My money is already going towards the FPSC model pack when it comes out anyways...

When FPSC develops enough, lets make a Redwall game!

Back to top
Profile PM Email
Sunflash
18
Years of Service
User Offline
Joined: 28th Jun 2005
Location: Seattle, Wa
Posted: 28th Feb 2006 01:27 Edited at: 28th Feb 2006 01:28
Link
Odd, it won't even let me download the demo, the links broken.
How does this program work? Is it like a text to to speech thing? Or is there more to it then just typing text and seeing the output?
-Sunflash

EDIT:

Quote: "DarkVOICES allows you to create lip sync mouth movement for your game characters easily, quickly and cost effectively. It is based on the technology of loading in any WAV file that contains speech, and converting it to a series of annotations which describe how the mouth should move."


Ok, that makes more sense. It would work much better then a text to speech thing this way!

When FPSC develops enough, lets make a Redwall game!

Back to top
Profile PM Email
Richard Davey
Retired Moderator
22
Years of Service
User Offline
Joined: 30th Apr 2002
Location: On the Jupiter Probe
Posted: 28th Feb 2006 01:49
Link
The problems with the demo download have been fixed. IIS was being an arse and I had to restart the file server.

Bite my shiny metal ass
Back to top
Profile PM Email Website
Sunflash
18
Years of Service
User Offline
Joined: 28th Jun 2005
Location: Seattle, Wa
Posted: 28th Feb 2006 01:52 Edited at: 28th Feb 2006 03:01
Link
Lol! I just came back to say that it was my error, I just downloaded the DirectX thing and retried the download and it worked like a charm, so I thought that maybe the TGC site somehow tests to see if you have it the patch installed, so I came back to post that it was my fault, then I saw that you had posted, lol!
-Sunflash

EDIT: OMG!! That program is sweet! Can you use it for programs besides DBP? Wow! I'm so surprised!
It was kinda buggy for me. For instance, Anna's hair was her gums and teeth, and other things with her texture was messed up. And that was when she was looking good! The first time I ran the program, she was textured with the wall texture (bricks)! Here's a screeny, she dosn't look happy!

Other than that, the program was sweet! Definently worth buying! I'd buy it if it worked for other programs like FPSC

When FPSC develops enough, lets make a Redwall game!

Attachments

Login to view attachments
Back to top
Profile PM Email
Sunflash
18
Years of Service
User Offline
Joined: 28th Jun 2005
Location: Seattle, Wa
Posted: 28th Feb 2006 03:00 Edited at: 28th Feb 2006 03:07
Link
Oops, I forgot to make that image a .JPG, I'll do that now...
Anyways, sorry for the double post, I just wanted to post some funny soundclips I made when I was bored. It's looks so funny in DV! At least, I think it does...

NOTE: THE SOUNDS ATACHED HERE ARE FREE TO BE USED IN ANY GAME, PRIVATE AND COMMERCIAL. BUT, YOU MUST SWEAR NEVER TO PUT ME IN THE CREDITS, OR TELL ANYONE WHO REALLY MADE THE SOUND CLIPS
I MEAN, MY REPUTATION IS AT STAKE HERE! (caps off)

When FPSC develops enough, lets make a Redwall game!

Attachments

Login to view attachments
Back to top
Profile PM Email
Cash Curtis II
19
Years of Service
User Offline
Joined: 8th Apr 2005
Location: Corpus Christi Texas
Posted: 28th Feb 2006 03:21 Edited at: 28th Feb 2006 03:21
Link
Very nice. It seems that I'm slowly buying every product TGC has released, and this has been added to the list.

By the way Rich, love the quote. Another good one - "Bite my colossal metal ass!"


Pong y2k.5 - Balls of Steel, Beta http://forum.thegamecreators.com/?m=forum_view&t=60999&b=8
Back to top
Profile PM
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 28th Feb 2006 07:17
Link
Quote: "IIS was being an arse and I had to restart the file server.
"

No apache?


Back to top
Profile PM Email Website
Nicholas Thompson
19
Years of Service
User Offline
Joined: 6th Sep 2004
Location: Bognor Regis, UK
Posted: 28th Feb 2006 10:43
Link
Quote: "No apache?"

I was wondering precisely the same thing!! Who in their right mind uses Windows as a server?


http://forum.antiblog.com, http://thingy-ma-jig.co.uk/new/
Back to top
Profile PM Email Website
BatVink
Moderator
21
Years of Service
User Offline
Joined: 4th Apr 2003
Location: Gods own County, UK
Posted: 28th Feb 2006 11:22
Link
Quote: "Who in their right mind uses Windows as a server?"

Maybe it's just the FTP server, that would make sense.

Back to top
Profile PM Email
Richard Davey
Retired Moderator
22
Years of Service
User Offline
Joined: 30th Apr 2002
Location: On the Jupiter Probe
Posted: 28th Feb 2006 14:36
Link
Apache runs the web site and forum, but isn't the best choice for a file server.

Quote: "It was kinda buggy for me. For instance, Anna's hair was her gums and teeth, and other things with her texture was messed up. And that was when she was looking good!"


Me thinks your video card doesn't like 2048x2048 sized textures

Bite my shiny metal ass
Back to top
Profile PM Email Website
David iz cool
18
Years of Service
User Offline
Joined: 21st Sep 2005
Location: somewhere lol :P
Posted: 28th Feb 2006 15:47
Link
cool! thanks Richard! i might get this sometime,since i wanted to add talking in my cutscenes.
Back to top
Profile PM
Image All
18
Years of Service
User Offline
Joined: 30th Dec 2005
Location: Home
Posted: 28th Feb 2006 16:43
Link
Blender can already do this

FunkyStickmen: Battle of the Races (1%)
Back to top
Profile PM Email
Richard Davey
Retired Moderator
22
Years of Service
User Offline
Joined: 30th Apr 2002
Location: On the Jupiter Probe
Posted: 28th Feb 2006 16:52
Link
Quote: "blender can already do this"


It can convert WAV files into phomemes? Strange, it doesn't mention it in the documentation.

Bite my shiny metal ass
Back to top
Profile PM Email Website
Image All
18
Years of Service
User Offline
Joined: 30th Dec 2005
Location: Home
Posted: 28th Feb 2006 17:07 Edited at: 28th Feb 2006 17:12
Link
You can give it a short WAV file of a sound, and then assign a keyframe to it. Keep assigning different keyframes to different sinewaves, and it will automatically animate the model when a certain part of your entire sinewave is recagnized, and assign a keyframe to it at that point in the animation.



FunkyStickmen: Battle of the Races (1%)
Back to top
Profile PM Email
Benjamin
21
Years of Service
User Offline
Joined: 24th Nov 2002
Location: France
Posted: 28th Feb 2006 17:10
Link
Then it can't really do what this can do, can it.

Tempest - P2P UDP Multiplayer Plugin - 70%
Back to top
Profile PM Email
Image All
18
Years of Service
User Offline
Joined: 30th Dec 2005
Location: Home
Posted: 28th Feb 2006 17:14 Edited at: 28th Feb 2006 17:17
Link
You can get the same results, but it takes more time, that's all. it's good if you want to have custom facial expressions, body language, or do sign language instead of moving a mouth, or both.

FunkyStickmen: Battle of the Races (1%)
Back to top
Profile PM Email
IanG
19
Years of Service
User Offline
Joined: 25th Sep 2004
Location: Cyberspace
Posted: 28th Feb 2006 17:54
Link
has anyone seen the demo movie - that is so funny, "baa baa bleep bleep oh dear i'm a sheep" who made that up?


amd athlon xp 2600+,1280mb,FX 5200 128mb,200gb,xp pro sp2
Back to top
Profile PM
Sunflash
18
Years of Service
User Offline
Joined: 28th Jun 2005
Location: Seattle, Wa
Posted: 28th Feb 2006 19:15
Link
Quote: "Me thinks your video card doesn't like 2048x2048 sized textures"


Lol, I guess it's time for a new graphics card, eh?

When FPSC develops enough, lets make a Redwall game!

Back to top
Profile PM Email
BatVink
Moderator
21
Years of Service
User Offline
Joined: 4th Apr 2003
Location: Gods own County, UK
Posted: 28th Feb 2006 21:02
Link
Quote: "You can give it a short WAV file of a sound, and then assign a keyframe to it. Keep assigning different keyframes to different sinewaves"


Then it doesn't compare in the slightest. I got an almost exact match, phoneme for phoneme...and it took about 8 seconds. It was so close, I didn't need to edit it manually.

Back to top
Profile PM Email
LeeBamber
TGC Lead Developer
24
Years of Service
User Offline
Joined: 21st Jan 2000
Location: England
Posted: 28th Feb 2006 22:51
Link
I made up the bah bah bleep bleep poem during my rapid development of this tool. It was going to be a serious poem, but my brain could only produce 'sarcastic' and 'silly', so I went with silly. The other random speeches are dittos Rick came up with to give our voice artist a hard time. The 'tooted a toot' one is amazingly pronounced, and very well done to the artist responsible!

"Small, smart, and running around the legs of dinosaurs to find enough food to survive, bedroom programmers aren't extinct after all "
Back to top
Profile PM Email Website
IanG
19
Years of Service
User Offline
Joined: 25th Sep 2004
Location: Cyberspace
Posted: 28th Feb 2006 23:00
Link
i thought it was funny, especially the "i want to show you something really hot, touching my..." (i'll leave that there ). It's just the way she says 'hot', as well, in a really slow kinda way.


amd athlon xp 2600+,1280mb,FX 5200 128mb,200gb,xp pro sp2
Back to top
Profile PM
FoxBlitzz
20
Years of Service
User Offline
Joined: 19th Nov 2003
Location: United States
Posted: 1st Mar 2006 00:00
Link
Is it me, or was that head taken from ATI's Ruby tech-demos?

AMD Athlon 64 X2 4200+
1GB DDR-SDRAM (May increase to 2GB one day)
512MB ATI Radeon X1800 Series - Finally! A card that does pixel shaders correctly!
Back to top
Profile PM Email
BatVink
Moderator
21
Years of Service
User Offline
Joined: 4th Apr 2003
Location: Gods own County, UK
Posted: 1st Mar 2006 01:57
Link
Quote: "i thought it was funny, especially the "i want to show you something really hot, touching my..." "


Glad I'm not alone on that one I mentioned that it was just...wrong

Back to top
Profile PM Email
Cash Curtis II
19
Years of Service
User Offline
Joined: 8th Apr 2005
Location: Corpus Christi Texas
Posted: 1st Mar 2006 02:11
Link
just...right...


Pong y2k.5 - Balls of Steel, Beta http://forum.thegamecreators.com/?m=forum_view&t=60999&b=8
Back to top
Profile PM
Philip
20
Years of Service
User Offline
Joined: 15th Jun 2003
Location: United Kingdom
Posted: 1st Mar 2006 02:11
Link
This is a really ingenious idea for a product. Well done to whoever it was who conceived the idea for it - I guess Lee?

Cheer if you like bears! Cheer if you like jam sandwiches!
Quote of the week: "... I started learning DBP while I was a Satellite Network Controller for the US Army Space Command ... "
Back to top
Profile PM Email
tschwarz
19
Years of Service
User Offline
Joined: 13th Feb 2005
Location: 127.0.0.1
Posted: 1st Mar 2006 03:05
Link
Downloaded the demo and then ordered it. Can't wait this is very cool. But, I do think it is cruel you didn't create a friend for her because she gets very sad if you don't interact with her all the time. Now that's some realism

Thanks
Back to top
Profile PM
Richard Davey
Retired Moderator
22
Years of Service
User Offline
Joined: 30th Apr 2002
Location: On the Jupiter Probe
Posted: 1st Mar 2006 03:46
Link
Quote: "Is it me, or was that head taken from ATI's Ruby tech-demos?"


It's just you. Simon created it from scratch (no dodgy Poser export) in 3DS Max. Hence why we are able to include it in a commercial product. I'm not entirely sure ATI would appreciate us selling a model from one of their tech demos, do you?

Bite my shiny metal ass
Back to top
Profile PM Email Website
The admiral
21
Years of Service
User Offline
Joined: 29th Aug 2002
Location:
Posted: 1st Mar 2006 07:14
Link
I would be interested as to how easily a model can be setup to use this system??

The admiral
Back to top
Profile PM Email Website
Sunflash
18
Years of Service
User Offline
Joined: 28th Jun 2005
Location: Seattle, Wa
Posted: 1st Mar 2006 07:24
Link
Same here, whatever happened to that tutuorial video that we're supposed to be seeing on the TGC website? (read the ReadMe.txt file)

When FPSC develops enough, lets make a Redwall game!

Back to top
Profile PM Email
Van B
Moderator
21
Years of Service
User Offline
Joined: 8th Oct 2002
Location: Sunnyvale
Posted: 1st Mar 2006 12:08
Link
I'm hoping it relies on a simple animated .X file, like something I could come up with in CharacterFX, I own Max, but don't have the time, nor the noodlage to learn it properly. If we can say, specify a frame start and end for a specific phoneme, and this program can blend them (like calculate more than one frame at once, for different parts of the face), then that's incredible - a simple animation job giving real nice lip sync.

Can it do other things besides react to sound triggers, like say we have a character walking down a corridor and they get a freight, could we animate a flinch on their face and have that kick in whenever we want? (like irrespective of what animation frame the rest of the model is using). Planning a survival horror game project, this package seems perfect for it.


Van-B

Put away, those fiery biscuits!
Back to top
Profile PM Email
BatVink
Moderator
21
Years of Service
User Offline
Joined: 4th Apr 2003
Location: Gods own County, UK
Posted: 1st Mar 2006 13:21
Link
Quote: "I'm hoping it relies on a simple animated .X file"


It doesn't rely on anything. DarkVOICES is raw data which you can apply to anything. You could use the data in other apps too, it's not tied to DB Pro or any particular model or method.

Back to top
Profile PM Email
Richard Davey
Retired Moderator
22
Years of Service
User Offline
Joined: 30th Apr 2002
Location: On the Jupiter Probe
Posted: 1st Mar 2006 19:45
Link
Quote: "whatever happened to that tutuorial video that we're supposed to be seeing on the TGC web"


They're on the Dark Voices page, right at the very bottom under 'Downloads'.

Bite my shiny metal ass
Back to top
Profile PM Email Website
Sunflash
18
Years of Service
User Offline
Joined: 28th Jun 2005
Location: Seattle, Wa
Posted: 1st Mar 2006 21:17 Edited at: 1st Mar 2006 21:20
Link
Yay! It was just added... awhile ago... lol, downloading it now

When FPSC develops enough, lets make a Redwall game!

Back to top
Profile PM Email
CJB
Valued Member
20
Years of Service
User Offline
Joined: 10th Feb 2004
Location: Essex, UK
Posted: 2nd Mar 2006 00:40
Link
She is HOT!!! Hooo Baby!!!



Back to top
Profile PM Email Website
CJB
Valued Member
20
Years of Service
User Offline
Joined: 10th Feb 2004
Location: Essex, UK
Posted: 2nd Mar 2006 00:42
Link
Seriously... Rather than learning how to use the output from Dark Voices, I would rather learn how the wav is analysed and broken up into phoneme chunks! Does it use some clever wave matching algorithm or something? Is the source code available!?!? (probably not I'm guessing!)

Back to top
Profile PM Email Website
CJB
Valued Member
20
Years of Service
User Offline
Joined: 10th Feb 2004
Location: Essex, UK
Posted: 2nd Mar 2006 00:52
Link
Just had a weird idea: What would it sound like if you played back phonetic sounds in the order of the lip-sync output? Would it be a simple voice synth!?!? If so, this could potentially be used to massively compress voice audio (potential use could be ULF transmission). Although I doubt the resulting voice would sound that great! Maybe if you could output the pitch of the voice along with the phonetics....

Back to top
Profile PM Email Website
Cash Curtis II
19
Years of Service
User Offline
Joined: 8th Apr 2005
Location: Corpus Christi Texas
Posted: 2nd Mar 2006 02:58 Edited at: 2nd Mar 2006 03:00
Link
Well, it displays the phenetic sounds that the lip is producing. Sound them out yourself and see what it sounds like. Nothing. Although, your lips should look like they're moving correctly

Although... I'm sure that you would sync it to some words, then substitute the synced wav with text to speech. Then it would be a matter of syncing it to time. But I promise, it would suck. Anna would sound much less sexy and much more 'Hello human, insert 20 dollars for the time of your life.' :b

The point : if you want it, just buy it. Sometimes, there's no substitute for shelling out some money.


Pong y2k.5 - Balls of Steel, Beta http://forum.thegamecreators.com/?m=forum_view&t=60999&b=8
Back to top
Profile PM
BatVink
Moderator
21
Years of Service
User Offline
Joined: 4th Apr 2003
Location: Gods own County, UK
Posted: 2nd Mar 2006 10:07
Link
Quote: "What would it sound like if you played back phonetic sounds in the order of the lip-sync output"


Pants.

Hum the Phoneme "ah". See how many octaves you can cover - probably 7 or 8. So that's around the range of a keyboard, all for one Phoneme.

Back to top
Profile PM Email
Benjamin
21
Years of Service
User Offline
Joined: 24th Nov 2002
Location: France
Posted: 2nd Mar 2006 16:16
Link
Quote: "See how many octaves you can cover - probably 7 or 8"

I doubt anyone has that kind of range.

Tempest - P2P UDP Multiplayer Plugin - 70%
Back to top
Profile PM Email
dark coder
21
Years of Service
User Offline
Joined: 6th Oct 2002
Location: Japan
Posted: 2nd Mar 2006 16:58
Link
well bats are ultrasonic so there cheating

Halowed are the ori.
Back to top
Profile PM Email
Back to top

Login to post a reply

Server time is: 2024-05-03 15:10:44
Your offset time is: 2024-05-03 15:10:44