shredx.modules.positional_encoding

Sinusoidal positional encoding for transformer models.

Classes

PositionalEncoding(d_model, sequence_length, ...)

Sinusoidal positional encoding for transformer models.