←back to thread

213 points Philpax | 1 comments | | HN request time: 0.777s | source
1. Scene_Cast2 ◴[] No.42171847[source]
If you're interested in positional embeddings for Transformers, check out this repo - https://github.com/gazelle93/Attention-Various-Positional-En... - it implements various popular ones.