Zum Inhalt springen
Kitbay

managing-amazon-msk

Apache-2.0Aktualisiert am 11. Nov. 20263.464GitHub-SterneEnthält Skripte

This aws-data-analytics skill operates Amazon MSK Provisioned clusters with Standard or Express brokers, which it warns models tend to confuse.

Was der Skill vermittelt

This aws-data-analytics skill operates Amazon MSK Provisioned clusters with Standard or Express brokers, which it warns models tend to confuse. It covers performance and consumer lag, storage, traffic shaping, choosing and sizing broker types, Kafka client tuning, CloudWatch alarms, cluster configuration, maintenance and rolling restarts, topic management, MSK Replicator for disaster recovery and active-active or active-passive replication, and streaming Kafka data into S3 Tables or general purpose S3. It includes a Python sizing script. Iceberg sinks through Flink and migrations from self-managed Kafka are left to other skills.

Funktionen

  • Size MSK Standard and Express brokers
  • Diagnose consumer lag and storage issues
  • Set up MSK Replicator
  • Deliver Kafka data to S3 Tables or S3