Skip to content

Commit

Permalink
more explanation of definitions
Browse files Browse the repository at this point in the history
  • Loading branch information
benlower committed Apr 15, 2024
1 parent 525547a commit b9a2489
Show file tree
Hide file tree
Showing 2 changed files with 8 additions and 6 deletions.
6 changes: 4 additions & 2 deletions website/src/components/HowToUse.astro
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,10 @@ import Section from './Section.astro';
<Section>
<div class="text-base">
<p class="text-xl font-bold mb-4">How to Use</p>
<p>The table below is interactive. You can sort on any column. Further, the hamburger menu (appears when you hover a column header) allows for custom filtering. <a class="underline hover:text-orange-600" href="#definitions">Definitions</a>, <a class="underline hover:text-orange-600" href="#methodology">methodology</a>, and links to <a class="underline hover:text-orange-600" href="#source">source</a> below.</p>
<p>The table below is interactive. You can sort on any column. Further, the hamburger menu (appears when you hover a column header) allows for custom filtering.</p>
<br />
<p>Have fun exploring!</p>
<p>Blue = best. Orange = worst.</p>
<br />
<p><a class="underline hover:text-orange-600" href="#definitions">Definitions</a>, <a class="underline hover:text-orange-600" href="#methodology">methodology</a>, and links to <a class="underline hover:text-orange-600" href="#source">source</a> below. Have fun exploring!</p>
</div>
</Section>
8 changes: 4 additions & 4 deletions website/src/utils/DataGridDefinitions.ts
Original file line number Diff line number Diff line change
Expand Up @@ -33,17 +33,17 @@ export const RegionDefinition = {

export const TTRDefinition = {
title: "TTR",
definition: "Time to (HTTP) Response. Indicates the overall speed of the serving infrastructure of the provider/model."
definition: "Time to (HTTP) Response. Indicates the overall speed of the serving infrastructure of the provider/model. Lower values = lower latency/faster performance."
};

export const TTFTDefinition = {
title: "TTFT",
definition: "Time to First Token. Time to get first text from the model. This translates directly into how quickly the UI starts to update when displaying the response and indicates the overall speed with which the model begins working on the request and processing the input tokens."
definition: "Time to First Token. Time to get first text from the model. This translates directly into how quickly the UI starts to update when displaying the response and indicates the overall speed with which the model begins working on the request and processing the input tokens. Lower values = lower latency/faster performance."
};

export const TPSDefinition = {
title: "TPS",
definition: "Tokens per Second. This is how quickly text is emitted from the model and translates directly into how quickly the UI finishes displaying the response. It also indicates how quickly the model can produce each output token."
definition: "Tokens per Second. This is how quickly text is emitted from the model and translates directly into how quickly the UI finishes displaying the response. It also indicates how quickly the model can produce each output token. Higher values = more throughput/faster performance."
};

export const TokensDefinition = {
Expand All @@ -53,7 +53,7 @@ export const TokensDefinition = {

export const TotalTimeDefinition = {
title: "Total Time",
definition: "The total time from the start of the request until the response is complete, i.e., the last token has been generated. Total time = TTFT + TPS * Tokens."
definition: "The total time from the start of the request until the response is complete, i.e., the last token has been generated. Total time = TTFT + TPS * Tokens. Lower values = lower latency/faster performance."
};

// Set-up all of our column definitions that will be used in the Data Grid
Expand Down

0 comments on commit b9a2489

Please sign in to comment.