Llion Jones

Co-inventor of the transformer architecture

  • Co-authored "Attention Is All You Need" (2017) while working at Google.
  • Was one of the longest-serving members of the original transformer team to remain at Google.
  • Founded Sakana AI in 2023, an AI research company based in Tokyo focused on nature-inspired intelligence.

Llion Jones is a Welsh computer scientist who was a researcher at Google and a co-author of the transformer paper. He remained at Google longer than most of his transformer co-authors, continuing work on AI research. He later founded Sakana AI, a Tokyo-based startup exploring nature-inspired approaches to artificial intelligence.

Milestones

  • The Architecture That Ate AI
    The Deep Learning Revolution Research
    The Architecture That Ate AI

    A team at Google introduced the Transformer, a deceptively simple attention-based model that would become the foundation of virtually every major AI breakthrough that followed.

    2017