Attention mechanisms are simply input processing techniques enable neural networks to process on specific details of the entire dataset at a time. In the case of image processing, the model checks that highly detailed features in distant portions of the image are consistent with one another. Similarly, when it comes to text processing, the model strives to make sure that distant portions of the document are thematically consistent.