Li Shuaiyi's picture

3 1

Li Shuaiyi

Syon-Li

https://github.com/Syon-Li

Syon-Li

AI & ML interests

Model editing, Long context, Compression

Recent Activity

upvoted a paper about 1 month ago

The End of Manual Decoding: Towards Truly End-to-End Language Models

upvoted a paper 5 months ago

MiroMind-M1: An Open-Source Advancement in Mathematical Reasoning via Context-Aware Multi-Stage Policy Optimization

authored a paper 12 months ago

A Silver Bullet or a Compromise for Full Attention? A Comprehensive Study of Gist Token-based Context Compression

View all activity

Organizations

None yet

authored 3 papers 12 months ago

A Silver Bullet or a Compromise for Full Attention? A Comprehensive Study of Gist Token-based Context Compression

Paper • 2412.17483 • Published Dec 23, 2024 • 34

Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language Models

Paper • 2412.16545 • Published Dec 21, 2024

Consecutive Batch Model Editing with HooK Layers

Paper • 2403.05330 • Published Mar 8, 2024

authored a paper over 1 year ago

On the Transformations across Reward Model, Parameter Update, and In-Context Prompt

Paper • 2406.16377 • Published Jun 24, 2024 • 13