Two Buckets and a Lambda: a pattern for file processing
This post is a “deep dive” on the architectural decisions, and operational concerns, and simple mechanics of triggering a Lambda from an S3 upload.
This post is a “deep dive” on the architectural decisions, and operational concerns, and simple mechanics of triggering a Lambda from an S3 upload.
Data has different purposes over time: when fresh, it can be used for real-time decision-making; as it ages, it becomes useful for analytics; eventually, it becomes a record, useful or perhaps not. Each of these stages requires a different approach to storage and management, and this talk looks at appropriate ways to work with your data at the different stages of its life.