Self-hosted fully working ST:TNG voice computer interface
21 days ago by troed to c/startrek
This has been my dream since I was a teen - and now the tech is real. This is a fork of an existing speech-to-speech project by Huggingface, with a lot of additions to add the right chimes, the voice* and the overall wakeword architecture.
I've had it running for a day and ... I like it. I'll most likely wire up a version of this throughout the house so the whole family can live the trekkie life :)
*) Cloning Barrett's voice ... I know. It's just little old me showing that we now have the tech, not some commercial venture. It's done with the utmost of respect for her craft throughout all those years!
This is cool as heck. Can you share the details at some point?
It needs some punch-card-shuffling noises to bring the TOS vibes. Great work!
That is cool as fuck. Nice job
I'd be tempted to have it switch voices for different purposes. Robert Picardo's EMH for medicinal queries, Kate Mulgrew for "what should I do" queries, alternate between James Doohan & LeVar Burton for technical stuff, etc. Might throw in some Lower Decks characters for fun, too.
quarks voice. crypto can be very lucrative.
And Michael for those teary eyed, pathos laden, dull speeches.
Is there a guide on how to duplicate this? I saw a voice to LLM back to voice tutorial a few weeks ago but it was much slower and the developer talked about the fixes needed that you must have implemented!
Fantastic! I built my own lcars control panel for a wall in my house using Html/JavaScript and always dreamed of finishing it with voice control.
I have a Home Assistant LCARS theme on my dashboard right now. Still learning how to make a nice looking dashboard with it.
Circa 2009-2010 there was a desktop overlay theme for Windows XP that I think was called System47. It was super basic, a LCARS overlay that let you access basic apps and info. It included a voice command which you could open apps or perform certain functions.
OMG I love this. Thank you for sharing!
What do you use for voice synthesis?
Majel was fine with her voice being used for computer so I don't think there's any problem there.
I think this topic is actually ripe for debate.
On one hand we know that Majel specifically recorded phonemes so her voice can be used for Star Trek purposes after her passing. While not a direct consent of "do whatever you want with my voice", the intent of similar purposes as OP's has been clearly present.
There's also Paramount's refusal to use her voice in new Trek, aside from a few snippets here and there (mostly Picard for the throwback value). Which kinda goes against the spirit of Trek.
On the other hand, the entire area of voice cloning is gray as fuck. It can very easily be used for nefarious purposes, yes - let that be corporate greed or fraud or propaganda. But if I make my own voice system, do I really hurt anyone by using their voice? I am not profiting off of it, I am not sharing the end result, it lives on my computer and that's it.
But, let's say I want to do the same. There's this TV show from some 20 years ago called Eureka. In it is one of the earliest representations of a smart house with an AI governor, called SARAH. SARAH is voiced by one of the recurring cast members, in fact it's an ongoing joke that the house is voiced by this guy "talking like a girl", and that he's trying to get Sarah Michelle Gellar to do the proper, final voice...
Now, the voice itself is pretty unique, but it isn't the voice of the actor, it's been heavily digitally edited. It's also a pretty unique voice but not something 99.9% of people would recognise. I make my clone from my own BR disk collection, with a set of automated and AI tools to get the right audio, clean it up, split by talker, and process all 77 episodes, manually selecting the right samples, manually tagging and labelling each; and finally, fine-tuning my own model for my own use. It will never leave my home, I won't sell or share it, and technically, with me owning the BR collection, this would fall under fair use.
Which is still quite different than, say, a corporate entity trying to sell more product by using your voice.
the so-called “First Lady of Star Trek” recorded an entire library of phonetic sounds, allowing her voice to be used in future products outside of Star Trek and, quite possibly, as the computer voice in Star Trek: Discovery.
Source: https://nerdist.com/...
It's not different than pirating an mp3.
A long time ago, I tried to tune a Piper voice using Majel Barrett's speech from her reading of the novel "Q In Law", but I didn't get very far - just a small amount of training data collected.
I agree; for reasons other people have discussed in detail here, I think Majel Barrett is probably one of the least ethically ambiguous actors you can do this with.
@startrek.website
r/startrek: The Next Generation
Star Trek news and discussion. No slash fic...
Maybe a little slash fic.
Rules
1 Be constructive
All posts/comments must be thoughtful and balanced.
2 Be welcoming
It is important that everyone from newbies to OG Trekkers feel welcome, no matter their gender, sexual orientation, religion or race.
3 Be truthful
All posts/comments must be factually accurate and verifiable. We are not a place for gossip, rumors, or manipulative or misleading content.
4 Be nice
If a polite way cannot be found to phrase what it is you want to say, don't say anything at all. Insulting or disparaging remarks about any human being are expressly not allowed.
5 Spoilers
Utilize the spoiler system for any and all spoilers relating to the most recently-aired episode. There is no formal spoiler protection for episodes/films after they have been available for approximately one week.
6 Keep on-topic
All submissions must be directly about the Star Trek franchise (the shows, movies, books, etc.). Off-topic discussions are welcome at c/Quarks.
7 Meta
Questions and concerns about moderator actions should be brought forward via DM.
Upcoming Episodes
| Date | Episode | Title |
|---|---|---|
| 08-20 | SNW 4x05 | "Level-Five Transporter Accident" |
| 08-27 | SNW 4x06 | “Off-Hour” |
| 09-03 | SNW 4x07 | “Like Chronitons Through the Hourglass” |
| 09-10 | SNW 4x08 | “Orders of Magnitude” |
| 09-17 | SNW 4x09 | "Once La’An a Time" |
Wondering where to stream a series? Check here.
go to feed...
@startrek.website
r/startrek: The Next Generation
Star Trek news and discussion. No slash fic...
Maybe a little slash fic.
Rules
1 Be constructive
All posts/comments must be thoughtful and balanced.
2 Be welcoming
It is important that everyone from newbies to OG Trekkers feel welcome, no matter their gender, sexual orientation, religion or race.
3 Be truthful
All posts/comments must be factually accurate and verifiable. We are not a place for gossip, rumors, or manipulative or misleading content.
4 Be nice
If a polite way cannot be found to phrase what it is you want to say, don't say anything at all. Insulting or disparaging remarks about any human being are expressly not allowed.
5 Spoilers
Utilize the spoiler system for any and all spoilers relating to the most recently-aired episode. There is no formal spoiler protection for episodes/films after they have been available for approximately one week.
6 Keep on-topic
All submissions must be directly about the Star Trek franchise (the shows, movies, books, etc.). Off-topic discussions are welcome at c/Quarks.
7 Meta
Questions and concerns about moderator actions should be brought forward via DM.
Upcoming Episodes
| Date | Episode | Title |
|---|---|---|
| 08-20 | SNW 4x05 | "Level-Five Transporter Accident" |
| 08-27 | SNW 4x06 | “Off-Hour” |
| 09-03 | SNW 4x07 | “Like Chronitons Through the Hourglass” |
| 09-10 | SNW 4x08 | “Orders of Magnitude” |
| 09-17 | SNW 4x09 | "Once La’An a Time" |
Wondering where to stream a series? Check here.
go to feed...
Oh thanks all for the nice comments! My fork is at https://github.com/troed/speech-to-speech but beware it's not kept in any other state than what I've last pushed :) Also you'll have to supply your own chime wavs and voice sample etc.
save