The Materialize Incremental View Maintenance Engine

At Materialize, Inc. we are building a high-throughput, low-latency SQL view maintenance engine. You write SQL queries against continually evolving relations, we give you back the answers fast. You ask the queries again and you get updated answers in milliseconds.

This system design departs fundamentally from both Spark-like and relational database systems, and is based instead on timely dataflow and differential dataflow. In this talk, we will go through the architectural highlights distinguish Materialize from prior systems, call out how they enable interactive queries over continually evolving data, and demonstrate the stack used for real-time data warehousing.