Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

when will you release code? #1

Open
jianlong-yuan opened this issue Mar 6, 2024 · 6 comments
Open

when will you release code? #1

jianlong-yuan opened this issue Mar 6, 2024 · 6 comments

Comments

@jianlong-yuan
Copy link

No description provided.

@TonyLianLong
Copy link
Owner

Working on the camera ready paper. We will release our code at about the same time.

@Bailey-24
Copy link

插个眼

@guyuchao
Copy link

guyuchao commented Apr 8, 2024

Hi, is there any update?

@TonyLianLong
Copy link
Owner

TonyLianLong commented Apr 8, 2024

We are still organizing the code repo, which will include both the LLM text-to-DSL part and DSL-to-video part based on cross-attention control. However, similar to LMD+, we offer a simple custom pipeline that uses video gligen adapters that we trained on our own to condition ModelScope.

Here is a colab that uses the model: https://colab.research.google.com/drive/17He4bFAF8lXmT9Nfv-Sg29iKtPelDUNZ

We plan to also add the LLM part to colab soon.

The text-to-DSL part is straightforward. You can use ChatGPT website for it. The prompt is in the paper appendix.

Example:

Prompt: An image of grassland with a dog walking from the left to the right.
download

@blE-lj
Copy link

blE-lj commented Apr 17, 2024

Hi, the work is very impressive and I'm looking forward to seeing your code, can I be informed of code release time?

@TonyLianLong
Copy link
Owner

@jianlong-yuan @Bailey-24 @guyuchao @blE-lj Thanks for your interest! The code and the benchmark have been released. Feel free to ask any questions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants