Skip to content

Commit

Permalink
Pre-warm audio models since they might spin down (#28)
Browse files Browse the repository at this point in the history
* Add audio radio button and action

* Update DataGrid.astro

* Pre-pre-warm audio models
  • Loading branch information
juberti authored Jul 15, 2024
1 parent 829a61d commit 7c49db5
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions .github/workflows/bench.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,9 @@ jobs:
steps:
- name: Send Benchmark Requests
run: |
# Pre-warm any spun-down instances (only audio right now)
curl -f -X POST "https://ai-benchmarks.fly.dev/bench?mode=audio&max_tokens=20&n=1"
# Run the benchmarks
regions=("sea" "iad" "cdg")
media=("text" "image" "audio")
for region in "${regions[@]}"; do
Expand Down

0 comments on commit 7c49db5

Please sign in to comment.