Toward Reliable Benchmarking of Solar Flare Forecasting Methods

Authors

• D. Shaun Bloomfield, Trinity College Dublin
• Paul A. Higgins, Trinity College Dublin
• R. T. James McAteer, New Mexico State University
• Peter T. Gallagher, Trinity College Dublin

Author ORCID Identifier

James McAteer:
https://orcid.org/0000-0003-1493-101X

Shaun Bloomfield:
https://orcid.org/0000-0002-4183-9895

Peter Gallagher:
https://orcid.org/0000-0001-9745-0400

Document Type

Journal Article

Journal Article Version

Final Version / Publisher's PDF (peer-reviewed)

Publication Date

3-10-2012

Abstract

Solar flares occur in complex sunspot groups, but it remains unclear how the probability of producing a flare of a given magnitude relates to the characteristics of the sunspot group. Here, we use Geostationary Operational Environmental Satellite X-ray flares and McIntosh group classifications from solar cycles 21 and 22 to calculate average flare rates for each McIntosh class and use these to determine Poisson probabilities for different flare magnitudes. Forecast verification measures are studied to find optimum thresholds to convert Poisson flare probabilities into yes/no predictions of cycle 23 flares. A case is presented to adopt the true skill statistic (TSS) as a standard for forecast comparison over the commonly used Heidke skill score (HSS). In predicting flares over 24 hr, the maximum values of TSS achieved are 0.44 (C-class), 0.53 (M-class), 0.74 (X-class), 0.54 (>= M1.0), and 0.46 (>= C1.0). The maximum values of HSS are 0.38 (C-class), 0.27 (M-class), 0.14 (X-class), 0.28 (>= M1.0), and 0.41 (>= C1.0). These show that Poisson probabilities perform comparably to some more complex prediction systems, but the overall inaccuracy highlights the problem with using average values to represent flaring rate distributions.

Published in

Astrophysical Journal Letters

DOI

10.1088/2041-8205/747/2/L41

Keywords

Sun: activity, Sun: flares, sunspots, magnetic fields

Department / Organizational Unit

Astronomy

Copyright Notice

© 2012 D. Bloomfield, P. Higgins, R. McAteer, et al., reuse allowed according to Creative Commons license.

License for Reuse

This work is licensed under a Creative Commons Attribution 4.0 International License.

Recommended Citation

Bloomfield, D. S., Higgins, P. A., McAteer, R. T. J., & Gallagher, P. T. (2012). Toward reliable benchmarking of solar flare forecasting methods. Astrophysical Journal Letters, 747(2). https://doi.org/10.1088/2041-8205/747/2/L41