Skip to content
Kitbay
Submit

creating-data-lake-table

Apache-2.0Updated on Nov 11, 20263,464GitHub stars

This aws-data-analytics skill creates managed Apache Iceberg tables in Amazon S3 Tables, which take care of compaction and snapshot cleanup.

What the skill teaches

This aws-data-analytics skill creates managed Apache Iceberg tables in Amazon S3 Tables, which take care of compaction and snapshot cleanup. It walks through checking dependencies, understanding the intended schema, creating the table bucket and namespace, integrating with the Glue Data Catalog so engines such as Athena can see the table, setting access controls with IAM, choosing a partitioning strategy, and creating and verifying the table, with troubleshooting tips. Importing files, vector storage, querying existing tables and finding tables are handled by sibling skills in the same plugin.

Capabilities

  • Create S3 table buckets, namespaces and Iceberg tables
  • Register tables with the Glue Data Catalog
  • Choose a partitioning strategy
  • Set table access controls