Repositories list

• Inf-CLIP

  Public
  The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A super memory-efficiency CLIP training scheme.

  memory-efficientclipcontrastive-learning+ 3flash-attentionring-attentioninfinite-batch-size

  Python

  •

  Apache License 2.0

  •9•218•3•0•Updated Jan 15, 2025Jan 15, 2025

• CoI-Agent

  Public
  Official code for paper: Chain of Ideas: Revolutionizing Research via Novel Idea Development with LLM Agents

  Python

  •

  Apache License 2.0

  •23•415•3•0•Updated Jan 15, 2025Jan 15, 2025

• VideoLLaMA2

  Public
  VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs

  Python

  •

  Apache License 2.0

  •66•1k•63•0•Updated Jan 10, 2025Jan 10, 2025

• VideoRefer

  Public
  The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"

  video-understandingmllmpixel-understanding+ 1sam2

  Python

  •5•140•1•0•Updated Jan 6, 2025Jan 6, 2025

• multimodal_textbook

  Public
  The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"

  Python

  •

  Apache License 2.0

  •13•114•3•1•Updated Jan 5, 2025Jan 5, 2025

• LLM-R2

  Public
  Python

  •6•38•4•0•Updated Nov 26, 2024Nov 26, 2024

• SeaExam

  Public
  SeaExam: Benchmarking LLMs for Southeast Aisa languages with Human Exam Questions

  Python

  •0•6•0•0•Updated Nov 26, 2024Nov 26, 2024

• SeaBench

  Public
  Python

  •0•2•0•0•Updated Nov 22, 2024Nov 22, 2024

• multilingual_analysis

  Public
  [NeurIPS 2024] How do Large Language Models Handle Multilingualism?

  Python

  •0•16•6•0•Updated Nov 8, 2024Nov 8, 2024

• DiGIT

  Public
  [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective

  transformerimage-generationgpt+ 4language-modelautoregressivefairseqneurips

  Python

  •

  MIT License

  •2•57•2•0•Updated Oct 31, 2024Oct 31, 2024

• reasoning-paths-optimization

  Public
  [EMNLP 2024] Reasoning Paths Optimization: Learning to Reason and Explore From Diverse Paths

  reasoningllm

  Python

  •

  Apache License 2.0

  •0•7•0•0•Updated Oct 30, 2024Oct 30, 2024

• CMM

  Public
  ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio

  Python

  •1•38•1•0•Updated Oct 17, 2024Oct 17, 2024

• VCD

  Public
  [CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding

  Python

  •

  Apache License 2.0

  •13•230•12•1•Updated Oct 7, 2024Oct 7, 2024

• Auto-Arena-LLMs

  Public
  Jupyter Notebook

  •

  Apache License 2.0

  •1•36•2•0•Updated Oct 7, 2024Oct 7, 2024

• WebDesignAgent

  Public
  WebDesignAgent : Towards Effortless Website Creation

  Python

  •

  Apache License 2.0

  •27•243•4•0•Updated Sep 20, 2024Sep 20, 2024

• LLM-argumentation

  Public
  [ACL2024] Exploring the Potential of Large Language Models in Computational Argumentation

  argument-miningargument-generationcomputational-argumentation+ 1llm

  Python

  •1•15•0•0•Updated Aug 21, 2024Aug 21, 2024

• DAMO-SeaLLMs

  Public
  [ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia

  JavaScript

  •13•154•9•0•Updated Jul 30, 2024Jul 30, 2024

• Video-LLaMA

  Public
  [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

  llamalarge-language-modelsvideo-language-pretraining+ 5vision-language-pretrainingcross-modal-pretrainingblip2minigpt4multi-modal-chatgpt

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •265•2.9k•60•6•Updated Jun 4, 2024Jun 4, 2024

• chain-of-knowledge

  Public
  [ICLR2024] Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sources

  Python

  •

  MIT License

  •9•60•2•0•Updated Jun 3, 2024Jun 3, 2024

• Multipurpose-Chatbot

  Public
  A chatbot UI for RAG, multimodal, text completion. (support Transformers, llama.cpp, MLX, vLLM)

  chatbot-applicationgradio-interfacellm-inference+ 1gradio-python-llm

  Python

  •

  Apache License 2.0

  •4•19•0•0•Updated Apr 18, 2024Apr 18, 2024

• AdamergeX

  Public
  Python

  •0•10•1•0•Updated Apr 2, 2024Apr 2, 2024

• LLM_summeval

  Public
  use gpt-turbo-3.5 to evaluate abstractive summaries

  Python

  •1•7•0•0•Updated Mar 20, 2024Mar 20, 2024

• HierEncDec

  Public
  code and data for "A Hierarchical Encoding-Decoding Scheme for Abstractive Multi-document Summarization"

  Python

  •1•9•2•0•Updated Mar 20, 2024Mar 20, 2024

• CLEX

  Public
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models

  large-language-modelsrotary-position-embeddinglong-context-modeling

  Python

  •

  MIT License

  •11•75•4•0•Updated Mar 12, 2024Mar 12, 2024

• multilingual-safety-for-LLMs

  Public
  [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"

  multilingualjailbreaksafety+ 1llm

  MIT License

  •6•64•0•0•Updated Mar 7, 2024Mar 7, 2024

• CaRing

  Public
  Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs

  Python

  •

  MIT License

  •5•34•0•0•Updated Feb 15, 2024Feb 15, 2024

• SOUL

  Public
  [EMNLP 2023] Code and Data for "SOUL: Towards Sentiment and Opinion Understanding of Language"

  natural-language-processingsentiment-analysis

  Python

  •

  MIT License

  •2•6•0•0•Updated Jan 17, 2024Jan 17, 2024

• TempReason

  Public
  Python

  •2•28•2•0•Updated Jan 11, 2024Jan 11, 2024

• CAST

  Public
  CAST - ACL 2023 Findings

  Python

  •0•3•1•0•Updated Jan 11, 2024Jan 11, 2024

• LLM-Data-Annotator

  Public
  0•6•1•0•Updated Jan 11, 2024Jan 11, 2024