X-CLIP (base-sized model)

X-CLIP model (base-sized, patch resolution of 16) trained on Kinetics-400. It was introduced in the paper Expanding Language-Image Pretrained Models for General Video Recognition by Ni et al. and first released in this repository.ai分析软件

This model was trained using 32 frames per video, at a resolution of 224×224.即梦下载官方

Disclaimer: The team releasing X-CLIP did not write a model card for this model so this model card has been written by the Hugging Face team.猫箱下载安装

Model description

X-CLIP is a minimal extension of CLIP for general video-language understanding. The model is trained in a contrastive way on (video, text) pairs.ai分析软件

This allows the model to be used for tasks like zero-shot, few-shot or fully supervised video classification and video-text retrieval.百度ai智能云

Intended uses & limitations

You can use the raw model for determining how well text goes with a given video. See the model hub to look for
fine-tuned versions on a task that interests you.

How to use

For code examples, we refer to the documentation.下载官方即梦a1

Training data

This model was trained on Kinetics 400.制作ai的软件

Preprocessing

The exact details of preprocessing during training can be found here.百度流畅ai制作

The exact details of preprocessing during validation can be found here.grok中文版下载

During validation, one resizes the shorter edge of each frame, after which center cropping is performed to a fixed-size resolution (like 224×224). Next, frames are normalized across the RGB channels with the ImageNet mean and standard deviation.al一键脱装入口

Evaluation results

This model achieves a zero-shot top-1 accuracy of 44.6% on HMDB-51, 72.0% on UCF-101 and 65.2% on Kinetics-600.人工智能ai哪个好