Vision Transformer (ViT)

A Transformer applied to images by splitting them into small patches that are treated like tokens in a sentence.

Introduced by Google researchers in 2020, ViT showed that with enough training data a plain Transformer could match or beat convolutional networks on image classification. ViT-style encoders are now common in multimodal models.

Read the Vision Transformer paper explained.

#Glossary #Computer Vision #Architecture

Stories about Vision Transformer (ViT)

Computer VisionResearch

Vision Transformer (ViT) explained: an image is worth 16×16 words

In 2020, Google showed that a plain transformer applied to image patches can rival convolutional networks. How ViT works, why it needs lots of data and what it enabled.

thelatentdaily.com Editorial TeamOct 184 min read