Gordon Murray’s Post

When I started exploring modern data engineering tools, I kept running into outdated examples. Deprecated Flink configs, old Iceberg syntax, broken Compose files. Versions change quickly but tutorials don’t. So I built something I wish I had sooner to help build projects. Its a collection of Claude Code Skills for Data Engineers, using Anthropic’s new Skills feature. Includes: • Apache Iceberg - snapshots, time travel, partition evolution • Apache Paimon - streaming lakehouse with LSM compaction • Lance -columnar format for ML & vector search • Apache Fluss - sub-second streaming storage • Docker Compose V2 - clean syntax, healthchecks, resource limits Some Example prompts: @iceberg/iceberg.md help me design a partition strategy @paimon/paimon.md create a CDC pipeline from MySQL Available here: https://lnkd.in/eX7mb4vy

Just added an Apache Flink skill, covering CDC, checkpoints, and operator tuning.

Like
Reply

To view or add a comment, sign in

Explore content categories