![A Survey of Attention Mechanism and Using Self-Attention Model for Computer Vision | by Swati Narkhede | The Startup | Medium A Survey of Attention Mechanism and Using Self-Attention Model for Computer Vision | by Swati Narkhede | The Startup | Medium](https://miro.medium.com/v2/resize:fit:1400/1*olo7NlYJh5CqxSrHjmFevw.png)
A Survey of Attention Mechanism and Using Self-Attention Model for Computer Vision | by Swati Narkhede | The Startup | Medium
![Spatial self-attention network with self-attention distillation for fine-grained image recognition - ScienceDirect Spatial self-attention network with self-attention distillation for fine-grained image recognition - ScienceDirect](https://ars.els-cdn.com/content/image/1-s2.0-S104732032100242X-gr3.jpg)
Spatial self-attention network with self-attention distillation for fine-grained image recognition - ScienceDirect
![Chaitanya K. Joshi on Twitter: "Exciting paper by Martin Jaggi's team (EPFL) on Self-attention/Transformers applied to Computer Vision: "A self- attention layer can perform convolution and often learns to do so in practice." Chaitanya K. Joshi on Twitter: "Exciting paper by Martin Jaggi's team (EPFL) on Self-attention/Transformers applied to Computer Vision: "A self- attention layer can perform convolution and often learns to do so in practice."](https://pbs.twimg.com/media/EKRtjJ9U8AAyOz3.jpg:large)
Chaitanya K. Joshi on Twitter: "Exciting paper by Martin Jaggi's team (EPFL) on Self-attention/Transformers applied to Computer Vision: "A self- attention layer can perform convolution and often learns to do so in practice."
![New Study Suggests Self-Attention Layers Could Replace Convolutional Layers on Vision Tasks | Synced New Study Suggests Self-Attention Layers Could Replace Convolutional Layers on Vision Tasks | Synced](https://i0.wp.com/syncedreview.com/wp-content/uploads/2020/01/image-25-1.png?fit=1137%2C526&ssl=1)
New Study Suggests Self-Attention Layers Could Replace Convolutional Layers on Vision Tasks | Synced
AK on Twitter: "Attention Mechanisms in Computer Vision: A Survey abs: https://t.co/ZLUe3ooPTG github: https://t.co/ciU6IAumqq https://t.co/ZMFHtnqkrF" / Twitter
![Researchers from Google Research and UC Berkeley Introduce BoTNet: A Simple Backbone Architecture that Implements Self-Attention Computer Vision Tasks - MarkTechPost Researchers from Google Research and UC Berkeley Introduce BoTNet: A Simple Backbone Architecture that Implements Self-Attention Computer Vision Tasks - MarkTechPost](https://www.marktechpost.com/wp-content/uploads/2021/03/Screen-Shot-2021-03-14-at-11.11.57-PM.png)