Jakob Uszkoreit

Co-inventor of the transformer and founder of Inceptive

  • Co-authored "Attention Is All You Need" (2017) as a researcher at Google.
  • Helped develop foundational self-attention mechanisms that replaced recurrent architectures in NLP.
  • Founded Inceptive, a company applying deep learning to biological sequence design and RNA therapeutics.

Jakob Uszkoreit is a German machine learning researcher who contributed to the transformer architecture during his time at Google. After co-authoring the influential 2017 paper, he pivoted to computational biology and founded Inceptive, which uses AI to design novel RNA molecules for therapeutic applications.

Milestones

  • The Architecture That Ate AI
    The Deep Learning Revolution Research
    The Architecture That Ate AI

    A team at Google introduced the Transformer, a deceptively simple attention-based model that would become the foundation of virtually every major AI breakthrough that followed.

    2017