Positional Encoding

sin/cos positional embedding

Free

Understand the Positional Encoding This is an educational App for readers interested in the sin/cos encoding of the token positions in large language models (LLM). Play with this App to acquire a deeper understanding of the positional encoder as it was described in the famous *Attention is All You Need* paper. In particular the App shows how the correlation between two positional vectors depends only on the distance between the corresponding two integer position.

  • This app has not received enough ratings or reviews to display an overview.

fixed a bug in dark-mode.

The developer, carl nohre, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy .

  • Data Not Collected

    The developer does not collect any data from this app.

    Privacy practices may vary based, for example, on the features you use or your age. Learn More

    The developer has not yet indicated which accessibility features this app supports. Learn More

    • Seller
      • carl nohre
    • Size
      • 1.6 MB
    • Category
      • Education
    • Compatibility
      Requires iOS 18.5 or later.
      • iPhone
        Requires iOS 18.5 or later.
      • iPad
        Requires iPadOS 18.5 or later.
      • Mac
        Requires macOS 15.5 or later.
      • Apple Vision
        Requires visionOS 2.5 or later.
    • Languages
      • English
    • Age Rating
      4+
    • Copyright
      • © carl nohre