Skip to content

Commit

Permalink
Added a reference to the language-scripture Confluence table.
Browse files Browse the repository at this point in the history
  • Loading branch information
Alexei-V-Ivanov-AMD committed Jan 13, 2025
1 parent 45b2246 commit f9dcea0
Showing 1 changed file with 12 additions and 1 deletion.
13 changes: 12 additions & 1 deletion benchmarks/P3L_MLING.py
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,17 @@
)
should result in PPL ~ 2.67962
The multi-linguality is implemented trough the additional
key "--lang-script", which defaults to English in Latin
scripture ("eng_Latn").
Please refer to
https://confluence.amd.com/display/MLSE/Multi-Lingual+P3L+Test
for the complete set of possible language-scripture choices.
"""

import argparse
Expand All @@ -49,8 +60,8 @@
import json
import math
import os
import pandas

import pandas
from huggingface_hub import hf_hub_download

from vllm import LLM, SamplingParams
Expand Down

0 comments on commit f9dcea0

Please sign in to comment.