Skip to content

Commit

Permalink
Release new docs to master
Browse files Browse the repository at this point in the history
  • Loading branch information
Milvus-doc-bot authored and Milvus-doc-bot committed Jan 13, 2025
1 parent ac8813c commit 6234880
Show file tree
Hide file tree
Showing 3 changed files with 12 additions and 8 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ If you are more familiar with PowerShell or Windows Command Prompt, the command
2. Download the installation script and save it as `standalone.bat`.​

```powershell
C:\>Invoke-WebRequest https://github.com/milvus-io/milvus/blob/master/scripts/standalone_embed.bat -OutFile standalone.bat​
C:\>Invoke-WebRequest https://raw.githubusercontent.com/milvus-io/milvus/refs/heads/master/scripts/standalone_embed.bat -OutFile standalone.bat​
```
Expand Down
10 changes: 7 additions & 3 deletions v2.5.x/site/en/integrations/integrate_with_langfuse.md
Original file line number Diff line number Diff line change
@@ -1,16 +1,20 @@
---
id: integrate_with_langfuse.md
summary: This is a simple cookbook that demonstrates how to use the LlamaIndex Langfuse integration. It uses Milvus Lite to store the documents and Query.
title: Cookbook LlamaIndex & Milvus Integration
title: Using Langfuse to Evaluate RAG Quality
---

# Cookbook - LlamaIndex & Milvus Integration
# Using Langfuse to Trace Queries in RAG

<a target="_blank" href="https://colab.research.google.com/github/langfuse/langfuse-docs/blob/main/cookbook/integration_llama-index_milvus-lite.ipynb">
<img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
</a>

This is a simple cookbook that demonstrates how to use the [LlamaIndex Langfuse integration](https://langfuse.com/docs/integrations/llama-index/get-started). It uses Milvus Lite to store the documents and Query.
This is a simple cookbook that demonstrates how to use Langfuse to trace your queries in RAG. The RAG pipeline is implemented with LlamaIndex and Milvus Lite to store and retrieve the documents.

In this quickstart, we’ll show you how to set up a LlamaIndex application using Milvus Lite as the vector store. We’ll also show you how to use the Langfuse LlamaIndex integration to trace your application.

[Langfuse](https://github.com/langfuse/langfuse) is an open-source LLM engineering platform that helps teams collaboratively debug, analyze, and iterate on their LLM applications. All platform features are natively integrated to accelerate the development workflow.

[Milvus Lite](https://github.com/milvus-io/milvus-lite/) is the lightweight version of Milvus, an open-source vector database that powers AI applications with vector embeddings and similarity search.

Expand Down
8 changes: 4 additions & 4 deletions v2.5.x/site/en/userGuide/search-query-get/full-text-search.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ summary: Full text search is a feature that retrieves documents containing speci

# Full Text Search​

Full text search is a feature that retrieves documents containing specific terms or phrases in text datasets, then ranking the results based on relevance. This feature overcomes semantic search limitations, which might overlook precise terms, ensuring you receive the most accurate and contextually relevant results. Additionally, it simplifies vector searches by accepting raw text input, automatically converting your text data into sparse embeddings without the need to manually generate vector embeddings.​
Full text search is a feature that retrieves documents containing specific terms or phrases in text datasets, then ranks the results based on relevance. This feature overcomes the limitations of semantic search, which might overlook precise terms, ensuring you receive the most accurate and contextually relevant results. Additionally, it simplifies vector searches by accepting raw text input, automatically converting your text data into sparse embeddings without the need to manually generate vector embeddings.​

Using the BM25 algorithm for relevance scoring, this feature is particularly valuable in retrieval-augmented generation (RAG) scenarios, where it prioritizes documents that closely match specific search terms.​

Expand All @@ -22,15 +22,15 @@ Using the BM25 algorithm for relevance scoring, this feature is particularly val

Full text search simplifies the process of text-based searching by eliminating the need for manual embedding. This feature operates through the following workflow:​

1. **Text input**: You insert raw text documents or provide query text without any need for manual embedding.​
1. **Text input**: You insert raw text documents or provide query text without needing to manually embed them.​

2. **Text analysis**: Milvus uses an analyzer to tokenize input text into individual, searchable terms.​ For more information on analyzers, refer to [Analyzer Overview](analyzer-overview.md).
2. **Text analysis**: Milvus uses an analyzer to tokenize the input text into individual, searchable terms.​ For more information on analyzers, refer to [Analyzer Overview](analyzer-overview.md).

3. **Function processing**: The built-in function receives tokenized terms and converts them into sparse vector representations.​

4. **Collection store**: Milvus stores these sparse embeddings in a collection for efficient retrieval.​

5. **BM25 scoring**: During a search, Milvus applies the BM25 algorithm to calculate scores for the stored documents and ranks matched results based on relevance to the query text.​
5. **BM25 scoring**: During a search, Milvus applies the BM25 algorithm to calculate scores for the stored documents and ranks matched results based on their relevance to the query text.​

![Full text search](../../../../assets/full-text-search.png)

Expand Down

0 comments on commit 6234880

Please sign in to comment.