Repositories tagged with "video-question-answering"
Ask-Anything
OpenGVLab
โ[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.โ
InternVideo
โ[ECCV2024] Video Foundation Models & Data for Multimodal Understandingโ
ClipBERT
jayleicn
โ[CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning on image-text and video-text tasks. โ
MiniGPT4-video
Vision-CAIR
โOfficial code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding โ
Youku-mPLUG
X-PLUG
โYouku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarksโ
ml-slowfast-llava
apple
โSlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Modelsโ
mPLUG-2
โmPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)โ
SeViLA
Yui010206
โ[NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answeringโ
NExT-QA
doc-doc
โNExT-QA: Next Phase of Question-Answering to Explaining Temporal Actions (CVPR'21)โ
ALPRO
salesforce
โAlign and Prompt: Video-and-Language Pre-training with Entity Promptsโ
Shot2Story
bytedance
โA new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.โ
FrozenBiLM
antoyang
โ[NeurIPS 2022] Zero-Shot Video Question Answering via Frozen Bidirectional Language Modelsโ
EMCL
jpthu17
โ[NeurIPS 2022 Spotlight] Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representationsโ
pytorch_violet
tsujuifu
โA PyTorch implementation of VIOLETโ
TVQAplus
โ[ACL 2020] PyTorch code for TVQA+: Spatio-Temporal Grounding for Video Question Answeringโ
just-ask
โ[ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videosโ
HBI
โ[CVPR 2023 Highlight & TPAMI] Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learningโ
Video-Question-Answering_Resources
chakravarthi589
โVideo Question Answering | Video QA | VQAโ