Skip to content
EN

Back to the catalog

Cloud-optimized weather & climate datadynamical.org
jsonEnglish

Cloud-optimized weather & climate data

dynamical.org · dynamical.org · English

A not-for-profit research lab advancing how we access, understand, and act on data about our world.

json

Open the feed

https://dynamical.org/feed/feed.json

Last post
Aug 31, 2026
Posts in 24 h · 7 days · 30 days
0 · 0 · 1
Our last check
Answering
Served from
United States
Text score at discovery
4,730
Format
json

Posts

What our queue read from this feed. Open one to read it here, or go to the site that published it.

  1. HRRR fam complete, the validation reports you crave
    Aug 31, 2026 · original
    I bring you good tidings, friends. Alden said our last newsletter was too long; that information can ONLY be delivered in groups of three. So just close your eyes for a moment (breathe in, breathe out) and imagine all the stuff we've done that he's NOT letting me tell you about. Pretty sick, right? Yeah, I'm proud of that one too. Mmhm, yes, per-file arrival. Anyway -- HRRR family reunion The HRRR story is filled out: 5 products for analysis and forecasts, spatial- and time-optimized, every model initialization and variable. The last one was a virtual HRRR analysis, complete with all variables and levels. Check them all out here: https://dynamical.org/catalog/#noaa-hrrr data.dynamical.org deprecations Technically the website says: data.dynamical.org access ends August 31, 2026. If you use a data.dynamical.org URL for this dataset, migrate to a supported access pattern. But we will extend
  2. OMGIMERG, Zarr-Python 3.3.0, analyzing forecast rollouts cont., NVIDIA Earth-2
    Jul 30, 2026 · original
    Who's the acronym artist at NASA responsible for this tomfoolery? Yes, IMERG is constructed from I ntegrated M ulti-satellit E (!!!) R etrievals for G PM. Next level. NASA IMERG Early and Late are live IMERG combines observations from a constellation of satellites into a global precipitation analysis. We now have two live-updating IMERG datasets in the catalog: NASA IMERG Early is available about 4 hours after observation time. NASA IMERG Late incorporates more observations and both forward and backward propagation, with a latency of roughly 12 to 18 hours. Both are global, 0.1° (~10 km), half-hourly, and extend back to 1998. They include precipitation rate and a precipitation quality index. We are releasing the Early and Late runs of IMERG V07. When NASA releases V08, we plan to add the Final run as well. Early: docs | notebook Late: docs | notebook Release trailer STAC + Icechunk Every
  3. Having it all: virtual and materialized data products
    Jul 16, 2026 · original
    We want it all: low-latency updates completeness over time, variables, and vertical dimensions access speed for time-series and map-style reads But when your data is 14 PB and 1 billion GRIB messages, making that dream a reality takes some work. Virtual Icechunk Zarrs are a key complement to our materialized (rechunked) Zarrs. Together they get us one step closer to the catalog of our dreams. We recently made a big push to build up our virtual Icechunk capabilities. This note describes why we create them, how we do it, and the lessons we've learned along the way. Why go virtual? For gridded weather data, thoughtfully designed virtual Zarrs offer three main benefits. Update latency. Because there's no heavyweight data to move around, our stores can reflect new data within seconds of it becoming available at the source. Completeness across variables and vertical dimensions. In cases where
  4. Low-latency HRRR, with all variables and levels, now in the catalog
    Jul 13, 2026 · original
    Are we living inside a Bostrom-esque simulation? Does that simulation exist inside another simulation ? There's only one way to find out: let's add increasing layers of derivative abstraction on already-digital signals that inadequately capture what the sheeple call "reality." Yeah?! Yeah. If anyone has Morpheus' phone number let him know I'm ready to be picked up on the Nebuchadnezzar. noaa-hrrr-forecast-48-hour-virtual is now available It is our first virtual dataset. It's low-latency, optimized for spatial access (i.e. good for maps) and has all variables and vertical levels. Try it out , and check out the release trailer . We now have the machinery for rigorous, high-performance virtual data products. You will see many more of these, and they will be as thoughtfully designed as our materialized data products. You can read more about our design process in Alden's lab note: Having it a
  5. Knowing the moment a forecast is ready
    Jul 7, 2026 · original
    Forecast production is a factory assembly line, a fulfillment center, and a delivery route all in one. Lewis Fry Richardson's Weather Forecasting Factory was not too far off. “Weather Forecasting Factory” by Stephen Conlin, 1986. Based on the description in Weather Prediction by Numerical Process, by L.F. Richardson, Cambridge University Press, 1922, and on advice from Prof. John Byrne, Trinity College Dublin. Image: ink and water colour, c. 50 x 38.5 cm. © Stephen Conlin 1986. All Rights Reserved. (Courtesy: Hendrik Hoffmann, School of Mathematics & Statistics, University College Dublin. Source ) Every dataset in the dynamical.org catalog (so far) is downstream of a model run that someone else produces on their own cadence. And the initialization is just the beginning (literally and philosophically). Then the files start landing, one by one, eventually trickling in over tens of minutes
  6. AIFS ENS and validation reports
    Jun 1, 2026 · original
    I was tempted, but alas Gefs (short for Gefsfry) did not make the cut for the name of my newborn son. He's here and everyone is healthy - so I'm getting back to it. Some catch-up: ECMWF AIFS ENS forecast The ensemble sibling to AIFS Single is now in the catalog. ECMWF AIFS ENS : 15-day global forecasts at 0.25°, 6-hourly steps, 51 members, updating every 6 hours. Archive starts 2025-07-02. Docs AWS Registry Earthmover Marketplace Source Coop Release trailer Validation reports Did you know Alden has knuckle tats? They spell ┌─┬─┬─┬─┐ ┌─┬─┬─┬─┐ │R│I│G│O│ │R│O│U│S│ └┬┴┬┴┬┴┬┘ └┬┴┬┴┬┴┬┘ │ │ │ │ │ │ │ │ ══╧═╧═╧═╧══ ══╧═╧═╧═╧══ To live up to the knuckles, we are adding in-depth validation reports to each catalog entry. For each variable, you get three views: a null-fraction trace over time (so you can see any gaps in the archive at a glance), side-by-side spatial maps comparing our dataset agai
  7. Time 2 Chunk (2.0), DWD ICON-EU, status for weather
    Apr 24, 2026 · original
    Listen, my second child is arriving any minute now. This transmission will be brief. I haven't decided if I will name him Poseidon, Gefs, or Turbulence. Zarr v3 deprecation We're all-in on Icechunk. Our existing Zarr v3 datasets will continue updating for 90 days, at which point we will sunset them. Consider them deprecated and update to use our Icechunk Zarrs by July 23, 2026 . Speaking of which The new access pattern: Via dynamical-catalog import dynamical_catalog # Open a dataset as an xarray Dataset via its Icechunk repository ds = dynamical_catalog . open ( "noaa-gfs-forecast" ) To more easily ensure the right set of dependencies and to make an increasingly variable set of opening incantations more accessible, we made a python library to list and open datasets. import dynamical_catalog # List all available datasets dynamical_catalog . list ( ) # Get the underlying Zarr store if you
  8. dynamical.org - icechunk 2.0 upgrade cometh
    Apr 17, 2026 · original
    Short one today — a quick housekeeping note for anyone pulling from our icechunk data products. Icechunk 2 is out ! If you're using our datasets via Icechunk, please update your Python library before Thursday April 24 : pip install icechunk --upgrade or uv add icechunk --upgrade Note that icechunk 2 requires Python 3.12 or higher. If you're on an older runtime, now's the time to bump it. We'll be targeting the v2 format going forward. Enjoy the weather , MM
  9. Rain, radar, and reckless optimism.
    Apr 1, 2026 · original
    Salutations, wxers. To balance out all the April 1 corporate tomfoolery I'm going to be less of a goofball today. Let's see if I can keep it STRICTLY BUSINESS. Lots to report since my last update. The dynamical(.org) core is a-running. ECMWF AIFS Single forecast The AI weather model from the European Centre has entered the catalog. ECMWF's AIFS Single — 15-day global forecasts at 0.25°, 6-hourly steps, live updating. This is the single-trace (deterministic-ish?) run of ECMWF's machine learning forecast system. Docs AWS Registry Earthmover Marketplace Source Coop And of course, don't miss the release trailer: Youtube | LinkedIn NOAA MRMS New CONUS RADAR dataset! MRMS is Multi-Radar Multi-Sensor — NOAA's merged radar and gauge precipitation analysis over CONUS, hourly, back to late 2014. If you've ever wanted to answer "how much did it actually rain here, at this exact hour" without downlo
  10. Warmer temps, datasets heating up.
    Mar 10, 2026 · original
    It's Spring and unlike hobbits (I'm reading LOTR), who would be thinking about gardens and second breakfast and whether Farmer Maggot's mushroom crop will come in early, we are staring at grib files. Just kidding, we are walking outside enjoying the warm weather ... while talking on the phone about grib files. We've been busy with a whole load of updates. GFS analysis is live Our old noaa-gfs-analysis-hourly was our "Hello World" — 4 variables, static, Zarr v2. It has been given a lovely retirement party and replaced with the new GFS analysis . Live! (not static) 21 variables (up from 4) Available in Zarr v3 and Icechunk Spatial domain Global Spatial resolution 0.25° Time resolution 1 hour HRRR analysis back to 2014 Four more sweet years. High Resolution Rapid Refresh has been retroactively retained through repeated re-retrieval - and now, re-released for a more uh... robust retrospectiv
  11. January cornucopia: AMS | HRRR analysis | more
    Jan 23, 2026 · original
    What say the pantheon of forecasts? Shall AMS travel be a disaster? As the flakes that fall thick upon a winter's day, when Zeus is minded to snow and to display these his arrows to humankind - he lulls the wind to rest, and snows hour after hour till he has buried the tops of the high mountains, the headlands that jut into the sea, the grassy plains, and the tilled fields of men... Find Alden @ AMS "What Happens When Weather Data is Easy to Use?" . Join Alden during the Environmental Data Access and Its Future: Open Data for Open Science Session on Monday, January 26 at 2:15 PM CT to explore how accessible weather data transforms research, operations, and decision-making across the atmospheric sciences community. Shoot him an email if you want to meet up and chat! HRRR analysis HRRR analysis (2018-09-16 to present) is now available in the catalog , including the Icechunk preview. Launch
  12. Preview of dynamical.org Icechunk Zarrs are now listed on the Registry of Open Data on AWS!
    Jan 8, 2026 · original
    Check out the Icechunk example usage in our docs for IFS ENS , GFS , and HRRR forecasts to get started or browse these datasets on the Registry of Open Data on AWS . Why Icechunk? Consistent reads every time. Updating a standard Zarr while users are reading it requires extreme care. Icechunk handles atomic updates correctly, eliminating rare race conditions that can occur during standard Zarr updates. Reliability and throughput. Icechunk is developing features to offer long-term stable dataset URLs. This provides direct access to underlying chunk data for high-throughput reads while allowing us to provide a permanent URL. Note: This feature will be part of the upcoming Icechunk 2.0, so when released dynamical.org will require a change to the access URL. Performance with default Python tooling. While the storage formats are similar, the Icechunk client is currently faster than default lib
  13. 🟢 ECMWF IFS ENS live and updating
    Nov 20, 2025 · original
    Colder temps may be here (where I live, at least), but ensembles are so hot right now . Can we agree on that? No? Ha ha get it!? As of this week The European Centre's IFS ENS forecast is live and updating in our catalog . See the catalog for init times, spatiotemporal domain, and the variable list. I suppose with that HRRR "release trailer" I've signed myself up for something completely unsustainable -- but until that time comes, when the catalog entries cometh faster than I can splice together sci fi video clips... -- ENS has a release trailer too . Icechunk Icechunk versions are available to select groups for testing (and will likely be our default in the future). If you want to try them out please respond. I've actually been a little surprised at the lack of Icechunk inquiries. Are y'all even drinking the cutting edge data format koolaide?! Sending from an airship above the clouds. En
  14. Wake up, babe. A new zarr just dropped.
    Sep 29, 2025 · original
    The last time I wrote you all, the summer sweltered, determinism was still alive (now it is dead , and only 11 AI weather papers had been published in Nature (now the total is up to 188,732). If I keep it up y'all are never going to take me seriously. But lo, some seriously new stuff! HRRR go brrr HRRR forecasts are live and updating! Check out the release trailer (lol) here . Give it a try! It'll be like that time in high school when you played too much Elder Scrolls Oblivion during a long weekend, and when you finally stepped outside into nature you thought to yourself "woah, these graphics are incredible." Catalog Notebook: Github | Colab Reformatter code A massive thanks to Alden, Tony, Alex and Sam for getting this one out there! Icechunk support We've also launched Earthchunk Icechunk versions of the GFS and HRRR forecasts. It's internal only until we sort out a few final details,
  15. 🟢 GFS is live
    Jul 2, 2025 · original
    GFS forecasts are live GFS is GEFS' less ambiguous older sibling. The archive is processed and the updater is chugging: 4 years of 16 day forecasts, hourly step, released 4 times a day. GFS might be wrong, but at least it's confident! A note from Alden, Chef de cuisine Tonight, I've prepared for you a dataset I think you will enjoy. Check out the example notebook linked in the docs to make your own interactive animation of an atmospheric river with buttery smooth hourly resolution. The way atmospheric rivers move reminds me of how rivers move on land , only on a time scale of hours not years. Served as a semifreddo with a peach compote. Steering committee The dynamical.org steering committee met and talked about [1] Data and [2] Things About Data Beyond My Comprehension. Read the summary notes podcast Did you catch episode number two of weathering ? This time we talked about Aardvark Wea
  16. introducing a new pod; GFS forecasts incoming
    Jun 14, 2025 · original
    Not even my proprietary UniverseCast™ Reality Ensemble Forecast⁺ could have predicted this. The most unlikely of scenarios: A podcast ? Yes, a podcast. And it's called Weathering . We are trying to make sense of the current wave of progress occurring in weather forecasting. Each episode, we focus on a paper or group of papers and try to take a intertextual approach -- clicking on mental hyperlinks to help us understand and put into context. The format is inspired by the only two podcasts I regularly listen to ( Future of Coding and Jed Sundwall's Techs on Texts ). Episode 001: The limits of predictability Our maiden voyage dives into a fresh-off-the-press paper from the University of Washington: Testing the Limit of Atmospheric Predictability With a Machine Learning Weather Model. Check it out, and let us know if there's a paper you think we should cover next. In normal dynamical.org new
  17. GEFS analysis is live!
    Apr 29, 2025 · original
    Well, technically it's been live for a few days. Check out our new GEFS analysis , which is derived from the GEFS forecast catalog item. Both are live updating, and the analysis was designed to work easily with the forecast dataset. For example, you can develop your algorithm/model/sentient AI television weatherperson on the analysis, and then deploy it live with the forecast dataset. COOL! 25+ years of data Live updating Performance optimized for time series queries Striving to create weather data experiences as satisfying as when you peel citrus in one contiguous piece. You know what I mean :) Enjoy the weather , MM
  18. 1 Million Requests!
    Mar 20, 2025 · original
    While modest on the scale of Computers, 1M is not bad for our baby’s first week in the world. The gigabytes are flying and we’ve received requests from 51 countries over the last few days. No single person has downloaded the whole dataset, so thank you but also WHAT ARE YOU WAITING FOR?! A reminder that the GEFS dataset is Zarr v3, so don’t forget to update your Xarray=2025.1.2 which includes v3 support! Let’s make Phase 1 happen (and how you can help) With GEFS complete, we are already working on our next slate of catalog additions. Our Phase 1 will include the following datasets: Forecasts NOAA GEFS, 35 day, 1x day (we did it) NOAA HRRR (Tony is on it!) NOAA GFS (Dan is on it!) NOAA GEFS, 10 day, 4x day ECMWF AIFS ECMWF ENS, 15 day, 1x day ECCC HRDPS Analyses NOAA GEFS (Alden is on it!) ECMWF AIFS ECMWF ENS NOAA HRRR NOAA GFS ECCC HRDPS Three ways you, dear reader, can help: [1] Financ
  19. About GEFS-fing Time & Introducing Our Steering Committee
    Mar 12, 2025 · original
    Weatherlings, the time has come for our first non-demo release. Weighing in at 115TB compressed and 815TB (!) uncompressed, GEFS ain’t messing around. Last year, we launched dynamical.org into the world and watched as hundreds of weather data nerds emerged (sublimated?) from the woodwork. Our community has been growing steadily, united by a shared mission to make weather data Spark Joy . 🌎 Introducing NOAA's Global Ensemble Forecast System (GEFS) 35-Day Forecasts! I am thrilled to announce the latest addition to Dynamical’s catalog: NOAA's Global Ensemble Forecast System (GEFS) 35-day forecasts! 📦 What's in the box? The Specs: Parameter Details Spatial Domain Global Spatial Resolution 0-240 hours: 0.25 degrees (~20km), 243-840 hours: 0.5 degrees (~40km) Time Domain Forecasts initialized 2020-10-01 00:00:00 UTC to Present Time Resolution Forecasts initialized every 24 hours Forecast Dom
  20. Alden @ AMS; GEFS zarrs?!
    Jan 10, 2025 · original
    CALLING ALL WEATHER DWEEBS! Bracing for a winter storm here in Nashville, where I moved to from Boston in order to escape winter storms. 3 to 7 inches they say - good thing I brought the XC skis! dynamical.org @ AMS From the look of it the vast majority of our subscribers will be at AMS. We are excited to see you there! Alden will be presenting at the 105th Annual Meeting of the American Meteorological Society (AMS) along with our first fiscal sponsor at Hydro-Québec! Their talk, titled “Fast, Easy, Open: Sustaining Live Updating, Analysis Ready, Cloud Optimized Weather Data Archives,” will highlight the vision behind dynamical.org and the drive to create and sustain ARCO weather datasets. 🗓️ When : Tuesday, January 14, 9:15 AM 📍 Where: 355 (New Orleans Ernest N. Morial Convention Center) If you’re at AMS, find Alden and Upstream Tech's Phil Butcher . Catalog Updates: GEFS is Almost He

Discovered by the rss-feed-index crawler, which checks each feed at most once a month.

Same record as JSON: https://api.agentalog.com/api/feeds/fd_dynamical_org_76e390482abb02a2. More from this site: dynamical.org in the Feeds tab.