Skip to content

Commit

Permalink
add g2p evals
Browse files Browse the repository at this point in the history
  • Loading branch information
fakerybakery authored Mar 16, 2024
1 parent 5b0b01f commit 7856887
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -60,14 +60,15 @@ phonemizer('hello this is a test')

## Evaluation

We introduce PhonemizerBench, a benchmark to evaluate the similarity of alternate Phonemizers to `espeak`.
We introduce PhonemizerBench, a benchmark to evaluate the similarity of alternate Phonemizers to `espeak` (this benchmark measures against `espeak`, assuming it's score is 100).

**Run 1**

| Phonemizer | Score |
| --- | --- |
| Gruut | 75.08 |
| DeepPhonemizer | 85.24 |
| G2P_EN | 86.16 |
| OpenPhonemizer | 93.64 |

**Run 2**
Expand All @@ -76,6 +77,7 @@ We introduce PhonemizerBench, a benchmark to evaluate the similarity of alternat
| --- | --- |
| Gruut | 75.54 |
| DeepPhonemizer | 85.03 |
| G2P_EN | 86.28 |
| OpenPhonemizer | 93.54 |

**Run 3**
Expand All @@ -84,6 +86,7 @@ We introduce PhonemizerBench, a benchmark to evaluate the similarity of alternat
| --- | --- |
| Gruut | 73.72 |
| DeepPhonemizer | 84.64 |
| G2P_EN | 85.74 |
| OpenPhonemizer | 93.38 |

## Todo
Expand Down

0 comments on commit 7856887

Please sign in to comment.