Yan Cui

Principal Engineer at DAZN


How to build observability into a serverless application

Your rating:

Serverless introduces a number of challenges to existing tools for observability, we need to adapt our practices to fit this new paradigm. In this talk we will see how you can implement log aggregation, tracing and correlation IDs for a serverless application.

In this talk we’ll introduce the challenges the serverless paradigm introduces to existing tools we use for observability:

  • nowhere to install monitoring agents/daemons
  • no background processing
  • higher concurrency to monitoring systems
  • lots more asynchronous invocations
We’ll then discuss how you can build observability into a serverless application, whilst touching on:
    • how to implement log aggregation
    • the need for structured logging and sampling debug logs in production
    • how to capture and forward correlation IDs through both synchronous (API Gateway) as well as asynchronous (SNS, Kinesis, S3, etc.) invocation events
    • how to capture performance traces to help debug performance issues


    Production-Ready Serverless: operational patterns and practices
    Tuesday 9:00 - 17:00
    Your rating:

    Getting started with AWS Lambda is easy, but understanding the operational challenges and tradeoffs is a much more nuanced topic, and one that you need to grasp before you can be confident in operating a serverless architecture responsibly.  In this workshop we will take you beyond the basics and teach you what you need to know to make your serverless application production ready!

    In this workshop we will cover:

    • AWS Lambda 101
    • Serverless framework 101
    • Writing integration and acceptance tests for AWS Lambda functions
    • CI/CD with CodePipeline and CodeBuild
    • Managing configurations with SSM Parameter Store
    • Per-function IAM roles
    • Structured logging
    • Sample logging
    • X-Ray integration
    • Capturing and forwarding correlation IDs


    Yan is an experienced engineer who has worked with AWS for near 10 years. He has been an architect and lead developer with a variety of industries ranging from investment banks, e-commerce to mobile gaming. Yan is an AWS Serverless Hero and has worked extensively with AWS Lambda in production. He has been very active in sharing his experiences and the lessons he has learnt.

    Yan is polyglot in both spoken and programming languages, he is fluent in both English and Mandarin, and counts C#, F#, Scala, Node.js and Erlang amongst programming languages that he has worked with professionally.

    Yan is a regular speaker at user groups and conferences internationally, and he is also the author of Production-Ready Serverless by Manning. In his spare time he keeps an active blog at https://theburningmonk.com where he shares his thoughts on topics such as AWS, serverless, functional programming and chaos engineering.

    Create account

    You need an account to save events or rate talks.

    Already have an account? Sign in

    Sign in

    Sign in to save events or rate talks.