Pangeo-Forge

A ⚡ lightning talk ⚡

Trey Stafford
Matt Fisher

2024-04-09

Pangeo-Forge overview

  • Inspired by conda-forge.
  • Community-driven recipes define pipelines for making datasets analysis-ready and cloud optimized (ARCO).
  • Apache Beam as underlying technology. Recently switched from Prefect.

Discussion highlights

  • Currently focused on Zarr.
  • Focused on NASA as a customer.
  • Governance is in flux. “Do-ocracy”.
  • Expecting a lot of churn/development over the next few years.

Resources