Esperanto tts

[JRMeyer]

>>> stergro
[August 26, 2019, 12:12pm]

Hey everyone, slash
looks like Esperanto has come a long way, we already have 20 hours of
audio in the dataset, recorded by over 140 contributors. I am very
impressed about your work and try to add some value to the dataset
myself. Plus I talk about this projekt on r/Esperanto, Mastodon,
duolingo and lernu.net to bring more people to
contribute in the project.

I am looking forward to see the first experiments with this dataset,
because afaik no one has ever tried machine learning with constructed
languages. I would guess that the regularity and the lack of exceptions
leads to very good results, even with small sample sizes.

I would love to experiment with text to speech in Esperanto. If this
leads to good results this could become a breakthrough for audiobooks in
Esperanto. Does the Mozzilla TTS engine run on a consumer laptop without
a fast GPU?

PS: some parts of the Common Voice website are not translated to
Esperanto yet. I tried to help a little but unfortunately I am only an
itermediate esperanto speaker and don't want to translate longer texts.
Does anybody want to help me translate the missing parts?

BTW: the article about Common Voice in the Esperanto
Wikipedia could use some
work, I will try to expand it this weekend.



[Add Esperanto

[This is an archived TTS discussion thread from discourse.mozilla.org/t/esperanto-tts]

[JRMeyer]

>>> nmstoker
[August 26, 2019, 12:11pm]

Mozilla TTS can be run for
inference on a laptop without a GPU (CPU will determine time to create
the text but it's fairly near real-time on my XPS 13)

One thing to note is that this data would be from multiple speakers and
TTS has handling of multi-speaker as a work in progress right now
(previously the speech data was from single speakers). Someone asked
about a similar scenario in one of the issues a couple of months back:
mozilla/TTS#213

[Archived Post]

[JRMeyer]

>>> stergro
[August 26, 2019, 12:11pm]

Okay, hope multi-speaker
setups are getting possible in the future. The dataset has pretty big
contributions from single donors. Would it make sense to train the TTS
with one of the donors who donated more than 1000 audio files? Or would
this be to little to get good results?

[Archived Post]

[JRMeyer]

>>> nmstoker
[August 26, 2019, 12:11pm]

I think it's a little early to tell best approach and others are
probably better placed to comment (eg
) but with the current single
speaker approach I'm pretty sure 1k recordings would be far too little
(assuming 5-10 seconds each) - I got vaguely intelligible results with
around 5hrs but it only really got decent when my sample set got well
beyond 10hrs.

[Archived Post]

[JRMeyer]

>>> stergro
[August 26, 2019, 12:11pm]

Okay good to know. Maybe creating a good TTS voice in esperanto has to
be a project of its own then (with a professional, selected speaker). I
looked a little closer on the dashboard, some speakers donated almost 2
000 donations, so maybe there will be a possibility in the future.

I still do belive that a completly regular language drastically
decreases the number of neccessary samples, but I guess I will have to
try it out to really know how much this is the case.

> I got vaguely intelligible results with around 5hrs but it only really
> got decent when my sample set got well beyond 10hrs.

You tried this with english, right
?

[Archived Post]

[JRMeyer]

>>> nmstoker
[August 26, 2019, 12:11pm]

Yes, I tried with English (with a collection of samples I'd produced /
recorded of my own voice)

[Archived Post]

[JRMeyer]

>>> nukeador
[August 26, 2019, 12:12pm]

Moving the part of the conversation about TTS to TTS category
![:slight_smile:](



[Esperanto-TTS

[Archived Post]

[JRMeyer]

[Archived] Esperanto tts

>>> _Nomota_Hiongun_KIM
[November 26, 2019, 2:06pm]

I'm now looking forward to an authentic Esperanto TTS, for buiding my
own educational systems. Are there any group of people trying to build
an Esperanto TTS engine out of this data set?

Normally how much of computing power is required, if I want to build a
TTS? I'm thinking of a personal level investment of a GPU equipped PC
within 20000 USD budget range. A single training session should not
exceed two weeks, so that I can try multiple times within 6 months. Is
it possible to build a decent TTS using this level of computing power?

[ slash #tirifto] [ slash #Esperanto]

### This is an archived TTS discussion thread from discourse.mozilla.org/t/esperanto-tts

[JRMeyer]

>>> stergro
[November 26, 2019, 10:23am]

Hey, AFAIK there is no group of people that work on this right now. I do
experiment with it a little. There is a complete section in this forum
about TTS, I already started a thread there about a Esperanto TTS:
Esperanto
TTS

The other thread is a little old. In the meantime I asked the mimic2-TTS
project if they support the common voice dataset and there is a way to
use this data: MycroftAI/mimic2#44

But remember: right now we only have around 30 hours of recordings by
200 donors in the esperanto dataset. For a good TTS you need around 15
hours by only one person in a good quality. Maybe it would be a better
approach to use free esperanto audiobooks from
librivox
as input data. This means some transcription work though.

But besides all this I am still planing to train a model with the CV
dataset just to see the results. Maybe a complete regular language needs
much less training data than a natural one, no one has every tested
this.

> I'm thinking of a personal level investment of a GPU equipped PC
> within 20000 USD budget range.

I assume you mean 2000 USD? This sounds like a good plan. You basically
need a lot of RAM and a good GPU. Just search 'gpu for machine learning'
and you will find a lot of information. But you can also always rent a
cloud-server to train your data.

> A single training session should not exceed two weeks, so that I can
> try multiple times within 6 months.

AFAIK the training will not take more than a week, maybe even less.
Right now with the small dataset it won't even take a day I guess.

[Archived Post]

[JRMeyer]

>>> nukeador
[November 26, 2019, 2:07pm]

Moving to TTS category.


[Archived Post]