Improving relative self-attention for music generation

Bach Samples

Relative Transformer

Piano-e-Competition Samples

Priming sequence

Relative Transformer

Vanilla Transformer

Performance RNN LSTM