File:Process of a Single Attention Head in a Transformer Model.jpg

From testwiki
Jump to navigation Jump to search
    Original file (2,000 × 1,858 pixels, file size: 298 KB, MIME type: image/jpeg)

    This file is from Wikimedia Commons and may be used by other projects. The description on its file description page there is shown below.

    Summary

    Description
    English: Visual representation of the self-attention mechanism within a single Transformer attention head, showing the transformation into Query, Key, and Value vectors and the weighted scoring process.
    Date
    Source Bioinformatics Advances, Volume 3, Issue 1, 2023, vbad001, https://doi.org/10.1093/bioadv/vbad001
    Author Shuang Zhang, Rui Fan, Yuti Liu, Shuang Chen, Qiao Liu, Wanwen Zeng

    Licensing

    w:en:Creative Commons
    attribution
    This file is licensed under the Creative Commons Attribution 4.0 International license.
    You are free:
    • to share – to copy, distribute and transmit the work
    • to remix – to adapt the work
    Under the following conditions:
    • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.

    Captions

    Visual representation of the self-attention mechanism within a single Transformer attention head, showing the transformation into Query, Key, and Value vectors and the weighted scoring process.

    11 January 2023

    image/jpeg

    304,901 byte

    1,858 pixel

    2,000 pixel

    df37bce7fb877cfa37c7b5759832acf4c35b8827

    File history

    Click on a date/time to view the file as it appeared at that time.

    Date/TimeThumbnailDimensionsUserComment
    current16:46, 30 November 2025Thumbnail for version as of 16:46, 30 November 20252,000 × 1,858 (298 KB)wikimediacommons>VV A-D-C-YUploaded a work by Shuang Zhang, Rui Fan, Yuti Liu, Shuang Chen, Qiao Liu, Wanwen Zeng from Bioinformatics Advances, Volume 3, Issue 1, 2023, vbad001, https://doi.org/10.1093/bioadv/vbad001 with UploadWizard

    There are no pages that use this file.