Monitoring, logging and data quality for pipelines

DEA-C01 · Data Operations and Support · Updated

Use CloudWatch, CloudTrail, Glue Data Quality, DataBrew and Athena log queries to monitor pipelines, troubleshoot failures and check data quality.

This lesson is part of full DEA-C01 access

The first 2 DEA-C01 lessons are free. Full access opens every lesson with its practice questions, and the exam-style DEA-C01 question bank.

In this lesson
  • Monitoring services
  • Querying logs with SQL
  • Data quality
  • Troubleshooting patterns
  • Exam traps
  • Practice questions

Get full access Try the free practice exam Log in

DEA-C01 course outline

All 8 lessons · Course overview
  1. AWS Glue ETL, crawlers and job bookmarksData Ingestion and Transformation Free
  2. Streaming ingestion with Kinesis, Firehose and MSKData Ingestion and Transformation Free
  3. S3 data lake storage, lifecycle and file formatsData Store Management Full access
  4. Redshift, Athena and choosing the right data storeData Store Management Full access
  5. Orchestrating pipelines with Step Functions, MWAA and EventBridgeData Operations and Support Full access
  6. Monitoring, logging and data quality for pipelinesData Operations and Support Full access
  7. Lake Formation, IAM and fine-grained data accessData Security and Governance Full access
  8. Encryption, secrets and network security for dataData Security and Governance Full access