Skip to content

Commit

Permalink
chore: fix ci lint
Browse files Browse the repository at this point in the history
  • Loading branch information
e1ijah1 committed Jan 13, 2025
1 parent d639d21 commit 714d54b
Showing 1 changed file with 6 additions and 2 deletions.
8 changes: 6 additions & 2 deletions benchmarks/backend_request_func.py
Original file line number Diff line number Diff line change
Expand Up @@ -428,12 +428,16 @@ def get_tokenizer(
pretrained_model_name_or_path = get_model(pretrained_model_name_or_path)
if tokenizer_mode == "slow":
if kwargs.get("use_fast", False):
raise ValueError("Cannot use the fast tokenizer in slow tokenizer mode.")
raise ValueError(
"Cannot use the fast tokenizer in slow tokenizer mode."
)
kwargs["use_fast"] = False
if tokenizer_mode == "mistral":
vllm_dir = os.path.dirname(os.path.dirname(os.path.abspath(__file__)))
sys.path.append(vllm_dir)
from vllm.transformers_utils.tokenizers import MistralTokenizer
from vllm.transformers_utils.tokenizers import (
MistralTokenizer
)

return MistralTokenizer.from_pretrained(str(pretrained_model_name_or_path))

Check failure on line 442 in benchmarks/backend_request_func.py

View workflow job for this annotation

GitHub Actions / ruff (3.12)

Ruff (E501)

benchmarks/backend_request_func.py:442:81: E501 Line too long (83 > 80)
else:
Expand Down

0 comments on commit 714d54b

Please sign in to comment.