Skip to content
This repository has been archived by the owner on Nov 30, 2024. It is now read-only.

Actions: microsoft/toktrie

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
46 workflow runs
46 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

add pointers for stuff being moved Rust #46: Commit f019408 pushed by mmoskal
November 30, 2024 22:50 In progress main
main
November 30, 2024 22:50 In progress
more lose versioning of hf tokenizers Rust #45: Commit f38eab5 pushed by mmoskal
November 30, 2024 18:37 1m 5s main
main
November 30, 2024 18:37 1m 5s
rename SPECIAL_TOKEN_PREFIX_BYTE to SPECIAL_TOKEN_MARKER Rust #44: Commit cbdd3d7 pushed by mmoskal
November 29, 2024 22:15 55s main
main
November 29, 2024 22:15 55s
add docs for special token prefix Rust #43: Commit 848784e pushed by mmoskal
November 29, 2024 21:56 53s main
main
November 29, 2024 21:56 53s
limit debug tokens to a maximum of 200 and indicate truncation in output Rust #42: Commit d8545d3 pushed by mmoskal
November 28, 2024 05:04 1m 14s main
main
November 28, 2024 05:04 1m 14s
update tokenize_is_approximate() to tokenize_is_canonical() Rust #41: Commit 2a90302 pushed by mmoskal
November 25, 2024 22:05 58s main
main
November 25, 2024 22:05 58s
update CI workflow to use --locked flag for cargo build Rust #40: Commit fafc88b pushed by mmoskal
November 25, 2024 21:43 58s main
main
November 25, 2024 21:43 58s
Merge pull request #6 from microsoft/dependabot/cargo/hf_tokenizers/r… Rust #39: Commit c8e792c pushed by mmoskal
November 25, 2024 21:19 55s main
main
November 25, 2024 21:19 55s
Bump rustls from 0.23.16 to 0.23.18 in /hf_tokenizers Rust #38: Pull request #6 opened by dependabot bot
November 25, 2024 17:01 1m 4s dependabot/cargo/hf_tokenizers/rustls-0.23.18
dependabot/cargo/hf_tokenizers/rustls-0.23.18
November 25, 2024 17:01 1m 4s
cargo in for rustls - Update #922291642 Dependabot Updates #2: by dependabot bot
November 25, 2024 17:00 46s main
main
November 25, 2024 17:00 46s
optimize decode_raw() Rust #37: Commit 148399b pushed by mmoskal
November 20, 2024 22:58 57s main
main
November 20, 2024 22:58 57s
add toktrie_tiktoken Rust #36: Pull request #5 opened by mmoskal
November 19, 2024 01:52 55s tiktoken
tiktoken
November 19, 2024 01:52 55s
fix compilation Rust #35: Commit 6172936 pushed by mmoskal
November 6, 2024 21:45 57s main
main
November 6, 2024 21:45 57s
force newer bytemuck Rust #34: Commit 36f9cf7 pushed by mmoskal
November 6, 2024 21:24 55s main
main
November 6, 2024 21:24 55s
update hf tokenizers Rust #33: Commit ad6be22 pushed by mmoskal
November 6, 2024 19:07 43s main
main
November 6, 2024 19:07 43s
Merge pull request #4 from v-jkegler/patch-1 Rust #32: Commit 4284824 pushed by mmoskal
November 5, 2024 01:13 59s main
main
November 5, 2024 01:13 59s
Merge pull request #2 from v-jkegler/patch-1 Rust #30: Commit 972825d pushed by mmoskal
October 28, 2024 20:27 54s main
main
October 28, 2024 20:27 54s
add SPECIAL_TOKEN_PREFIX_BYTE Rust #28: Commit a2af4e0 pushed by mmoskal
October 26, 2024 00:05 57s main
main
October 26, 2024 00:05 57s
add TokTrie.with_info() Rust #27: Commit 1e39ea4 pushed by mmoskal
October 23, 2024 18:42 1m 9s main
main
October 23, 2024 18:42 1m 9s
add TokEnvWithTrie Rust #26: Commit 5e7013a pushed by mmoskal
September 26, 2024 17:34 58s main
main
September 26, 2024 17:34 58s
add utility methods Rust #25: Commit 8828701 pushed by mmoskal
September 7, 2024 19:43 51s main
main
September 7, 2024 19:43 51s
update impl/hw notes Rust #24: Commit f437079 pushed by mmoskal
September 6, 2024 15:25 56s main
main
September 6, 2024 15:25 56s
add more info on impl Rust #23: Commit 76f77d1 pushed by mmoskal
September 5, 2024 17:23 1m 6s main
main
September 5, 2024 17:23 1m 6s
add more impl notes Rust #22: Commit b217d0e pushed by mmoskal
September 5, 2024 15:42 51s main
main
September 5, 2024 15:42 51s
dial down the trie stats Rust #21: Commit 7cb20cd pushed by mmoskal
August 18, 2024 23:30 1m 4s main
main
August 18, 2024 23:30 1m 4s