enerzyme.models.blocks.attention

Classes

Attention(dim_qk[, num_random_features])

Efficient (linear scaling) approximation for attention described in Choromanski, K., et al. "Rethinking Attention with Performers.".