sigmoid based JAX implementation for top-p quantized.

Input

1167-dim embedding

Encoder

36 x Transformer with 16 heads

Output

mAP projection

regularization based PyTorch implementation for gradient optimizer.

Input

866-dim embedding

Encoder

99 x Transformer with 62 heads

Output

f1 projection