Multiverse Computing interview question

Questions about transformers architecture and embeddings