Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Benchmarks (MovieChat1k and VDC) and VLMs (MovieChat and AuroraCap) #719

Open
wants to merge 11 commits into
base: main
Choose a base branch
from

Conversation

Espere-1119-Song
Copy link

  • We add MovieChat to the vlm. We describe the torch version and additional code needed by MovieChat in code.
  • We add AuroraCap to the vlm. We describe the additional code needed by MovieChat in code. Note that AuroraCap need torch version lower than 2.5.0
  • We add MovieChat-1K to the dataset, which uses chatgpt3.5-0125 as the judgment assistant.
  • We add VDC to the dataset, which uses llama3.1-8B as the judgement assistant. Note that, when evaluation with VDC, the installation of lmdeploy is needed for acceleration.

@FangXinyu-0913 FangXinyu-0913 self-assigned this Jan 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants