Code

Add Swin model#394

Code

Merged

jonatanklosko merged 15 commits intoelixir-nx:mainelixir-nx/bumblebee:mainfrom bosko:swin-modelbosko/bumblebee:swin-modelCopy head branch name to clipboardSep 3, 2024

+804-3

Commits

Commits on Aug 16, 2024

• Added Swin model

  bosko

  committed
  772fdd3

  Copy full SHA for 772fdd3

• feat: windows partitioning and calculating attention mask

  bosko

  committed
  a0dd299

  Copy full SHA for a0dd299

• feat: completed all layers but still not functional

  bosko

  committed
  eee7a46

  Copy full SHA for eee7a46

• fix: attention mask is expected to be boolean mask

  bosko

  committed
  a0326f3

  Copy full SHA for a0326f3

• feat: splitting layers as suggested by Jonatan (still not able to load model)

  bosko

  committed
  132bc60

  Copy full SHA for 132bc60

• fix: attention results handling, roll function call and dense calculation

  bosko

  committed
  6ba22ae

  Copy full SHA for 6ba22ae

• feat: added all layers for each block

  bosko

  committed
  3c8e8b3

  Copy full SHA for 3c8e8b3

• feat: pad if needed and implemented relative position index function

  bosko

  committed
  ed36ec0

  Copy full SHA for ed36ec0

• feat: we are calculating attention due to Swin specifics

  bosko

  committed
  2666d6c

  Copy full SHA for 2666d6c

• feat: removed Bumblebee attention usage

  bosko

  committed
  87e9f92

  Copy full SHA for 87e9f92

Commits on Aug 19, 2024

• fix: calculating layer output

  bosko

  committed
  42a5a64

  Copy full SHA for 42a5a64

• feat: added Swin test

  Show description for 5984318
  bosko

  committed
  5984318

  Copy full SHA for 5984318

Commits on Aug 23, 2024

• Add tests

  jonatanklosko

  committed
  12de8ad

  Copy full SHA for 12de8ad

Commits on Sep 3, 2024

• Fixes and refactor

  jonatanklosko

  committed
  740a345

  Copy full SHA for 740a345

• Up

  jonatanklosko

  committed
  1b3c5a0

  Copy full SHA for 1b3c5a0