Ashish Vaswani

Co-inventor of the transformer architecture

  • Co-authored the landmark 2017 paper "Attention Is All You Need" while at Google Brain.
  • Conducted research on sequence-to-sequence models and neural machine translation at Google.
  • Co-founded Adept AI, a startup focused on building AI systems that can take actions on computers.

Ashish Vaswani (born 1986) is an Indian computer scientist who was a key researcher at Google Brain. He is best known as the lead author of “Attention Is All You Need,” the 2017 paper that introduced the transformer architecture, which became the foundation for modern large language models. After leaving Google, he co-founded the AI startup Adept AI.

Milestones

  • The Architecture That Ate AI
    The Deep Learning Revolution Research
    The Architecture That Ate AI

    A team at Google introduced the Transformer, a deceptively simple attention-based model that would become the foundation of virtually every major AI breakthrough that followed.

    2017