I also want to share some resources.
For Pytorch,

• https://pytorch.org/tutorials/ their basic tutorials are fundamental but some more advanced tutorials might be outdated.
• https://www.learnpytorch.io/ the author guides mostly in computer vision but he gives the overview from research to production.

For TPU,

• https://github.com/ayaka14732/tpu-starter full guideline using TPUs with Jax

https://github.com/Jamie-Stirling/RetNet non-official implementation

I know we are moving away from Reddit. However, if I don't link, I feel like we may miss out good threads on r/machinelearning. Moreover, the authors don't only post arxiv links, they post other sutff such as Summary, Key points, ... (e.g this).

So can I at least put them in the posts instead of posting in a comment?

Related links:

• https://luogen1996.github.io/lavin/
• https://github.com/luogen1996/LaVIN

I will follow then.

indeed it would be great if the authors did so. I personally found some non-official implementations:

• https://github.com/kyegomez/PALI
• https://github.com/...

• SigLIP
• PaLI
• PaLI-X

https://github.com/...

The idea is similar to BLIP-2. Both papers use learnable tokens as queries for a transformer decoder. This decoder query from vision space base on the trainable queries and prompt.

IIRC DeTr generate a sequence to predict boxes of objects. I think this paradigm can be applied to such models. "Think before you locate" could be a new path to explore.

Relevant links

• https://queryable.app/
• https://apps.apple.com/...

Reddit thread: https://www.reddit.com/...

Relevant links:

• https://github.com/...
• https://arxiv.org/abs/2209.02299

Related links:

• https://github.com/lucidrains/MaMMUT-pytorch
• https://ai.googleblog.com/...

Github link