Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration/end-to-end tests #127

Open
sd2k opened this issue Oct 30, 2023 · 0 comments
Open

Integration/end-to-end tests #127

sd2k opened this issue Oct 30, 2023 · 0 comments

Comments

@sd2k
Copy link
Contributor

sd2k commented Oct 30, 2023

We have some unit tests for the plugin backend (health checks, resource endpoints, and streams). We don't have any for the vector stuff, but I think integration tests would make more sense here.

Ideally we would have some integration tests which ran the plugin inside Grafana with some combinations of config (e.g. OpenAI proxy configured with either Azure or OpenAI; vector service configured with qdrant or Grafana Vector API), and call the various plugin endpoints. Not sure how we'd handle auth with OpenAI or Azure there though.

It would be nice to also test that the grafana-experimental package also works with each version of the LLM app plugin, but those tests may need to live in a separate repository, either https://github.com/grafana/grafana-experimental or possibly https://github.com/grafana/grafana-llmexamples-app (e.g. inside one or more example Grafana plugins, for full E2E tests).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant