Łukasz Kaiser

Co-inventor of the transformer and researcher in neural program synthesis

  • Co-authored "Attention Is All You Need" (2017) while a researcher at Google Brain.
  • Published extensively on neural machine translation, program synthesis, and formal reasoning in neural networks.
  • Authored "Logic and Games on Automatic Structures," reflecting his background bridging formal logic and machine learning.

Łukasz Kaiser is a Polish machine learning researcher who was part of the Google Brain team that created the transformer architecture. His research spans neural machine translation, program synthesis, and the intersection of formal logic with deep learning. He later joined OpenAI, continuing work on large-scale language models.

Milestones

  • The Architecture That Ate AI
    The Deep Learning Revolution Research
    The Architecture That Ate AI

    A team at Google introduced the Transformer, a deceptively simple attention-based model that would become the foundation of virtually every major AI breakthrough that followed.

    2017