SAP Interview Question

Describe the recent adaptations to Transformer architecture