Presenting our LISA paper at NeurIPS 2024😆
- Dec. 13 at 4:30 pm (Friday afternoon)
- West Ballroom A-D #5708

Fine-tuning 7B in a single GPU❔ Randomly freezing ~90% self-attention layers every 5-20 iterations allows that!🚀It is
- 3x Fast
- Memory-efficient
- Good at… pic.twitter.com/sogQclVoDn

— Rui Pan (@rui4research) December 9, 2024