Probabilistic verification of global and mesoscale ensemble forecasts of tropical cyclogenesis

Sharanya J Majumdar, Ryan D. Torn

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

Probabilistic forecasts of tropical cyclogenesis have been evaluated for two samples: a near-homogeneous sample of ECMWF and Weather Research and Forecasting (WRF) Model-ensemble Kalman filter (EnKF) ensemble forecasts during the National Science Foundation's (NSF) Pre-Depression Investigation of Cloudsystems in the Tropics (PREDICT) field campaign (15 August-30 September 2010) and ECMWF ensemble forecasts during the 2010-12 Atlantic hurricane seasons. Quantitative criteria for tropical cyclone (TC) formation were first determined from model analyses based on threshold values of lower-tropospheric circulation, local thickness anomaly, and minimum sea level pressure. A binary verification was then performed for all ensemble forecasts with initial-time tropical disturbances. During the PREDICT period, the ECMWF and WRF-EnKF had similar verification statistics, with reliability diagrams of positive slope flatter than unity, and relative operating characteristic (ROC) curves that demonstrate skill. For the 2010-12 ECMWFensemble forecasts, the equitable threat score was small and positive, with skill mostly lost after 5 days. The reliability diagrams for 1-5-day forecasts were monotonic increasing, though an overly large number of short-range ensemble forecasts predicted a low probability of a TC when a TC was verified. The ROC curves exhibited similar skill for forecasts out to 5 days. The reliability curves were sensitive to parameters such as time tolerance and threshold values, and insensitive to cases that originated from African easterly waves versus those that did not. Qualitative investigations revealed case-to-case variability in the probabilistic predictions. While the sample size was limited, the ensembles showed the potential for probabilistic prediction out to 5 days, though it appeared that the model struggled with developing a warm core in the short-range forecast.

Original languageEnglish (US)
Pages (from-to)1181-1198
Number of pages18
JournalWeather and Forecasting
Volume29
Issue number5
DOIs
StatePublished - 2014

Fingerprint

cyclogenesis
tropical cyclone
Kalman filter
diagram
ensemble forecasting
easterly wave
weather
forecast
sea level pressure
prediction
hurricane
tolerance
anomaly
disturbance

ASJC Scopus subject areas

  • Atmospheric Science

Cite this

Probabilistic verification of global and mesoscale ensemble forecasts of tropical cyclogenesis. / Majumdar, Sharanya J; Torn, Ryan D.

In: Weather and Forecasting, Vol. 29, No. 5, 2014, p. 1181-1198.

Research output: Contribution to journalArticle

@article{525bd559d13e451aac22e0463279cef7,
title = "Probabilistic verification of global and mesoscale ensemble forecasts of tropical cyclogenesis",
abstract = "Probabilistic forecasts of tropical cyclogenesis have been evaluated for two samples: a near-homogeneous sample of ECMWF and Weather Research and Forecasting (WRF) Model-ensemble Kalman filter (EnKF) ensemble forecasts during the National Science Foundation's (NSF) Pre-Depression Investigation of Cloudsystems in the Tropics (PREDICT) field campaign (15 August-30 September 2010) and ECMWF ensemble forecasts during the 2010-12 Atlantic hurricane seasons. Quantitative criteria for tropical cyclone (TC) formation were first determined from model analyses based on threshold values of lower-tropospheric circulation, local thickness anomaly, and minimum sea level pressure. A binary verification was then performed for all ensemble forecasts with initial-time tropical disturbances. During the PREDICT period, the ECMWF and WRF-EnKF had similar verification statistics, with reliability diagrams of positive slope flatter than unity, and relative operating characteristic (ROC) curves that demonstrate skill. For the 2010-12 ECMWFensemble forecasts, the equitable threat score was small and positive, with skill mostly lost after 5 days. The reliability diagrams for 1-5-day forecasts were monotonic increasing, though an overly large number of short-range ensemble forecasts predicted a low probability of a TC when a TC was verified. The ROC curves exhibited similar skill for forecasts out to 5 days. The reliability curves were sensitive to parameters such as time tolerance and threshold values, and insensitive to cases that originated from African easterly waves versus those that did not. Qualitative investigations revealed case-to-case variability in the probabilistic predictions. While the sample size was limited, the ensembles showed the potential for probabilistic prediction out to 5 days, though it appeared that the model struggled with developing a warm core in the short-range forecast.",
author = "Majumdar, {Sharanya J} and Torn, {Ryan D.}",
year = "2014",
doi = "10.1175/WAF-D-14-00028.1",
language = "English (US)",
volume = "29",
pages = "1181--1198",
journal = "Weather and Forecasting",
issn = "0882-8156",
publisher = "American Meteorological Society",
number = "5",

}

TY - JOUR

T1 - Probabilistic verification of global and mesoscale ensemble forecasts of tropical cyclogenesis

AU - Majumdar, Sharanya J

AU - Torn, Ryan D.

PY - 2014

Y1 - 2014

N2 - Probabilistic forecasts of tropical cyclogenesis have been evaluated for two samples: a near-homogeneous sample of ECMWF and Weather Research and Forecasting (WRF) Model-ensemble Kalman filter (EnKF) ensemble forecasts during the National Science Foundation's (NSF) Pre-Depression Investigation of Cloudsystems in the Tropics (PREDICT) field campaign (15 August-30 September 2010) and ECMWF ensemble forecasts during the 2010-12 Atlantic hurricane seasons. Quantitative criteria for tropical cyclone (TC) formation were first determined from model analyses based on threshold values of lower-tropospheric circulation, local thickness anomaly, and minimum sea level pressure. A binary verification was then performed for all ensemble forecasts with initial-time tropical disturbances. During the PREDICT period, the ECMWF and WRF-EnKF had similar verification statistics, with reliability diagrams of positive slope flatter than unity, and relative operating characteristic (ROC) curves that demonstrate skill. For the 2010-12 ECMWFensemble forecasts, the equitable threat score was small and positive, with skill mostly lost after 5 days. The reliability diagrams for 1-5-day forecasts were monotonic increasing, though an overly large number of short-range ensemble forecasts predicted a low probability of a TC when a TC was verified. The ROC curves exhibited similar skill for forecasts out to 5 days. The reliability curves were sensitive to parameters such as time tolerance and threshold values, and insensitive to cases that originated from African easterly waves versus those that did not. Qualitative investigations revealed case-to-case variability in the probabilistic predictions. While the sample size was limited, the ensembles showed the potential for probabilistic prediction out to 5 days, though it appeared that the model struggled with developing a warm core in the short-range forecast.

AB - Probabilistic forecasts of tropical cyclogenesis have been evaluated for two samples: a near-homogeneous sample of ECMWF and Weather Research and Forecasting (WRF) Model-ensemble Kalman filter (EnKF) ensemble forecasts during the National Science Foundation's (NSF) Pre-Depression Investigation of Cloudsystems in the Tropics (PREDICT) field campaign (15 August-30 September 2010) and ECMWF ensemble forecasts during the 2010-12 Atlantic hurricane seasons. Quantitative criteria for tropical cyclone (TC) formation were first determined from model analyses based on threshold values of lower-tropospheric circulation, local thickness anomaly, and minimum sea level pressure. A binary verification was then performed for all ensemble forecasts with initial-time tropical disturbances. During the PREDICT period, the ECMWF and WRF-EnKF had similar verification statistics, with reliability diagrams of positive slope flatter than unity, and relative operating characteristic (ROC) curves that demonstrate skill. For the 2010-12 ECMWFensemble forecasts, the equitable threat score was small and positive, with skill mostly lost after 5 days. The reliability diagrams for 1-5-day forecasts were monotonic increasing, though an overly large number of short-range ensemble forecasts predicted a low probability of a TC when a TC was verified. The ROC curves exhibited similar skill for forecasts out to 5 days. The reliability curves were sensitive to parameters such as time tolerance and threshold values, and insensitive to cases that originated from African easterly waves versus those that did not. Qualitative investigations revealed case-to-case variability in the probabilistic predictions. While the sample size was limited, the ensembles showed the potential for probabilistic prediction out to 5 days, though it appeared that the model struggled with developing a warm core in the short-range forecast.

UR - http://www.scopus.com/inward/record.url?scp=84910631804&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84910631804&partnerID=8YFLogxK

U2 - 10.1175/WAF-D-14-00028.1

DO - 10.1175/WAF-D-14-00028.1

M3 - Article

AN - SCOPUS:84910631804

VL - 29

SP - 1181

EP - 1198

JO - Weather and Forecasting

JF - Weather and Forecasting

SN - 0882-8156

IS - 5

ER -