Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question: what is the purpose of "stores" #201

Open
punkish opened this issue Jan 7, 2025 · 0 comments
Open

Question: what is the purpose of "stores" #201

punkish opened this issue Jan 7, 2025 · 0 comments
Assignees
Labels
question Further information is requested

Comments

@punkish
Copy link

punkish commented Jan 7, 2025

Per the docs,

EmbedJs comes with built-in support for data persistance beyond vector embeddings. The kind of data that can be persisted includes -
  • Loaders and chunks loaded and their metadata,
  • Loader specific caching,
  • Conversation history

What is the purpose of this datastore? I see the schema as below for the stores db but I can't figure out the use for this other than perhaps for the conversations table, in case, I want to show the users their history of questions. But, in that case, how would I identify which questions belong to which user? (assuming, I have a system with multiple users, most likely a web-based Q&A app).

CREATE TABLE conversations (
            id              TEXT PRIMARY KEY,
            conversationId  TEXT NOT NULL,
            content         TEXT NOT NULL,
            timestamp       TEXT NOT NULL,
            actor           TEXT NOT NULL,
            sources         TEXT
        );
CREATE TABLE loaders (
            id              TEXT PRIMARY KEY,
            type            TEXT NOT NULL,
            chunksProcessed INTEGER,
            metadata        TEXT
        );
CREATE TABLE loaderCustomData (
            key             TEXT PRIMARY KEY,
            loaderId        TEXT NOT NULL,
            value           TEXT
        );
@adhityan adhityan added the question Further information is requested label Jan 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants