Skip to content

Latest commit

 

History

History
23 lines (14 loc) · 721 Bytes

README.md

File metadata and controls

23 lines (14 loc) · 721 Bytes

LLM Pipeline Eval

A testing framework for LLM and RAG pipelines to help ensure your RAG and LLMs perform at expected levels.

Built in Rust for speed, but interop libraries to be developed for integration into various languages.

Platform Support

Architecture Rust C# Python
Linux (x64) ✓ ✓ Soon
Windows - - -

Evaluations

Evaluation BERT LLM RAG
Similarity ✓ ✓ ✓

Development Notes

  • Rust library was not built with async in mind, it is expected the interop libraries will handle async operations due to the differences in how languages handles threads.