Common Voice Scripted Speech 23.0 - Toki Pona

Locale: tok

Size: 461.56 MB

Task: ASR

Format: MP3

License: CC-0


toki pona — Toki Pona (tok)

This datasheet has been generated automatically, we would love to include more information, if you would like to help out, get in touch!

This datasheet is for version 23.0 of the the Mozilla Common Voice Scripted Speech dataset for Toki Pona (tok). The dataset contains 19221 clips representing 23 hours of recorded speech (16 hours validated) from 170 speakers.

Demographic information

The dataset includes the following distribution of age and gender.

Gender

Self-declared gender information, percentage refers to the number of clips annotated with this gender.

GenderPertentage
Undefined41.0%
Male Masculine52.0%
Female Feminine5.0%
Do Not Wish To Say3.0%

Age

Self-declared age information, percentage refers to the number of clips annotated with this age band.

Age BandPercentage
Undefined31.0%
Twenties19.0%
Thirties6.0%
Teens21.0%
Eighties23.0%

Data splits for modelling

The official data splits for modelling this language are as follows. Of the validated clips, 55.09% are included in the splits.

SplitCount
Train2635
Test2248
Dev2251

Text corpus

The text corpus contains 9744 sentences, of which 7498 are validated, 2246 are invalidated and 165 are reported.

Sample

There follows a randomly selected sample of five sentences from the corpus.

mije lili li awen lon suno pi mun lili lon len pi pimeja tomo.
nimi pi soweli sina li seme?
sina ken ala awen lon ni.
lupa lili li lon len ilo pi lupa lukin.
kalama suwi la, mi mute li pana e pona ali tawa nimi sewi.

Text domains

DomainCount
Undefined19219
Finance2
General2

Fields

Each row of a tsv file represents a single audio clip, and contains the following information:

  • client_id - hashed UUID of a given user

  • path - relative path of the audio file

  • text - supposed transcription of the audio

  • up_votes - number of people who said audio matches the text

  • down_votes - number of people who said audio does not match text

  • age - age of the speaker1

  • gender - gender of the speaker1

  • accent - accent of the speaker1

  • segment - if sentence belongs to a custom dataset segment, it will be listed here

Community links

Contribute

Licence

This dataset is released under the Creative Commons Zero (CC-0) licence. By downloading this data you agree to not determine the identity of speakers in the dataset.

Footnotes

  1. For a full list of age, gender, and accent options, see the demograpics spec. These will only be reported if the speaker opted in to provide that information. 2 3