By migrating AdRoll's real-time data pipeline to Kinesis we were able to reduce our end to end latency more than one hundredfold while simultaneously cutting costs and improving system stability. Here we'll follow architectural decisions, implementation details, and overall learnings from this process.
