Thu 03
Is Attention a Budget or a Curve?
Attention budget and attention curve describe different parts of the same problem. Budget is about how much attention there is. Curve is about how it gets distributed across the context.
Attention budget and attention curve describe different parts of the same problem. Budget is about how much attention there is. Curve is about how it gets distributed across the context.