Wix Engineering

Aviran Mordo, Yaniv Event Haim, Asaf Yonay For decades, the role of the software engineer seemed straightforward: identify a problem and solve it by writing code. But the rise of powerful AI models is beginning to reshape that definition. With systems like Claude Code, Codex, Cursor and other advanced coding assistants, something important has become clear across the industry: writing code itself is gradually becoming a commodity. This does not mean software engineering is becoming less...

At Wix, our Data Warehouse (DWH) is a massive repository of insights. Built on Amazon S3 using Apache Iceberg table formats, and populated by Trino and Spark jobs, it houses petabytes of data—from user segmentation and logs to AI chat analytics. However, storage is only half the battle. The real challenge—and the "holy grail" for many data engineering teams—is Activation : taking that petabyte-scale data and exposing it to backend microservices with millisecond latency, high availability, and...

1. Introduction: The Challenge Understanding the engineering need for AirBot starts with recognizing the scale of the ecosystem it operates within. Wix operates a massive cloud-based development platform serving 250 million users. This generates over 4 billion HTTP transactions daily, feeding a data lake that currently holds 7 petabytes of data. To manage this volume, Wix Data Engineering maintains over 3,500 Apache Airflow pipelines (DAGs) . These pipelines handle everything from ETL...