Skip to content
Kitbay

migrate-to-msk

Apache-2.0Updated on Nov 11, 20263,464GitHub starsIncludes scripts

A skill in AWS's aws-data-analytics plugin for moving self-managed Apache Kafka to Amazon MSK Express.

What the skill teaches

A skill in AWS's aws-data-analytics plugin for moving self-managed Apache Kafka to Amazon MSK Express. It builds an inventory of the source cluster from infrastructure-as-code files, Kafka CLI output or manual input, checks compatibility with MSK Express across topology, Kafka version, configuration, authentication and quotas, and proposes a target specification with instance type, broker count and monthly cost borrowing pricing rules from the managing-amazon-msk skill. It can optionally create a trial Express cluster to load-test the workload, and guides the migration itself with MSK Replicator. It ships Python scripts for compatibility checks and load-test configuration.

Capabilities

  • Inventory a self-managed Kafka cluster
  • Assess compatibility with MSK Express
  • Size and cost a target MSK Express cluster
  • Load-test a trial cluster before migrating