Spatial Autocorrelation in the Magnetosphere-Ionosphere System

A Unified Three-Source Moran's I Pipeline
Bruce Stephenson & Argus
May 2026 · has-anyone-looked project
Contents

1. Why Spatial Autocorrelation?

The magnetosphere-ionosphere (M-I) system is a driven dissipative continuous system. The solar wind drives energy into the magnetosphere; that energy dissipates through ionospheric currents, particle precipitation, and Joule heating. Between the driving and the dissipation, the system self-organizes into spatial patterns.

This framing comes directly from Busse & Kramer's "Nonlinear Evolution of Spatio-Temporal Structures in Dissipative Continuous Systems" (NATO ASI Series B, Vol. 225, 1990). Their framework asks: given a spatially extended system with energy input and dissipation, what patterns emerge? How do those patterns depend on driving conditions? How do different observational windows reveal different aspects of the same underlying structure?

Core question: When the solar wind drives the M-I system, do ground magnetic perturbations become spatially coherent? Does the ionospheric electron density respond with similar patterns? And can we see the same structure in simulations?

Spatial autocorrelation is the natural tool for this question. It measures whether nearby locations tend to have similar values (positive autocorrelation = patterns) or dissimilar values (negative = checkerboard), compared to what you'd expect from random placement. A geomagnetic storm that drives coherent large-scale currents should create positive spatial autocorrelation in ground magnetometer measurements. Quiet times should show noise — near-zero autocorrelation.

2. Moran's I: A Primer

Moran's I is the spatial analog of Pearson's correlation coefficient. Where Pearson measures association between two variables, Moran's I measures association between a variable and its spatially-lagged self — i.e., how similar is each location to its neighbors?

I = (N / S₀) · Σᵢ Σⱼ wᵢⱼ (xᵢ - x̄)(xⱼ - x̄) / Σᵢ (xᵢ - x̄)²

where N is the number of observations, wᵢⱼ are spatial weights (how "connected" locations i and j are), and S₀ = Σwᵢⱼ. The expected value under spatial randomness is E[I] = −1/(N−1), which approaches zero for large N.

Positive I (clustered) + + + Like values cluster together I ≈ 0 (random) + + + No spatial pattern Negative I (dispersed) + + + + + Checkerboard — opposites neighbor

Figure 1. Moran's I captures three regimes of spatial organization. In M-I physics: storms tend to create the left pattern (coherent perturbations), while quiet times produce the middle pattern (spatially uncorrelated noise).

Weight Matrices

The choice of weight matrix W determines what "neighbor" means. We use two types:

Inverse-distance weights (for irregular stations)

For SuperMAG and SWMF stations at irregular positions, we use wᵢⱼ = 1/dᵢⱼ (haversine distance), row-normalized so that each station contributes equally regardless of how many neighbors it has. This follows the PySAL convention and prevents dense clusters from dominating the statistic. Self-weights are zero (wᵢᵢ = 0).

Queen contiguity (for regular grids)

For TEC on the CODE GIM 2.5°×5° grid, we use 8-neighbor queen contiguity — each grid cell is connected to its 8 surrounding cells (N, S, E, W, and diagonals), with wrap-around at the dateline. Also row-normalized. This is the natural choice for gridded data where the grid spacing is the meaningful "neighbor" scale.

Why row-normalize? Without normalization, stations in dense clusters (like Scandinavia) would dominate the statistic because they have more high-weight neighbors. Row normalization asks: "on average, does each station look like its neighbors?" rather than "do the densely-sampled regions look smooth?"

3. Three Windows into M-I Coupling

Earth Ionosphere (~300 km) SuperMAG Ground magnetometers 42+ stations (N. hemisphere) 1-minute cadence NEZ components (nT) Measures: δB at surface GPS TEC CODE Global Ionosphere Maps 2.5° × 5° grid (71 × 73) 2-hour cadence (13/day) VTEC in TECU Measures: ∫n_e dl (ionosphere) SWMF / BATS-R-US MHD simulation, 12 virtual stations Biot-Savart: total = MHD+FAC+Hall+Ped Measures: simulated δB (decomposed) δB ← J_iono + J_mag TEC ← n_e structure Simulated δB sources

Figure 2. Three observational windows into the magnetosphere-ionosphere system. Each measures a different physical quantity at a different spatiotemporal resolution.

SuperMAG: Ground Magnetometers

SuperMAG is a worldwide collaboration of ground magnetometer networks providing standardized baseline-subtracted measurements of geomagnetic field variations. Our dataset includes 42+ stations across the Northern Hemisphere at 1-minute cadence, measuring north (N), east (E), and vertical (Z) components of δB in nanotesla.

Ground magnetometers measure the integrated effect of all current systems above them: magnetospheric currents (ring current, magnetopause, cross-tail), field-aligned currents connecting magnetosphere to ionosphere, and ionospheric Hall and Pedersen currents. The ground δB is the superposition of all these sources — which, as we'll see, creates a fundamental observability problem.

Station network map

Figure 3. Ground magnetometer network showing 42 SuperMAG stations (blue) and 12 SWMF CCMC virtual stations (red stars). Green circles mark overlap stations. Northern high-latitude coverage spans North America, Scandinavia, and Siberia.

SWMF / BATS-R-US: Simulated Magnetometer Decomposition

The Space Weather Modeling Framework couples a global MHD magnetosphere model (BATS-R-US) with an ionospheric electrodynamics solver (Ridley). Using Biot-Savart integration, it computes the ground magnetic perturbation at virtual magnetometer locations and decomposes it into four current sources:

ComponentSourcePhysical Origin
MHDMagnetosphericRing current, magnetopause, cross-tail
FACField-AlignedRegion 1/Region 2 current system
HallIonospheric HallE-region horizontal closure currents
PedersenIonospheric PedersenF-region field-perpendicular currents

The total is: δB_total = δB_MHD + δB_FAC + δB_Hall + δB_Pedersen. Each column carries 15 values (N, E, D for each source). We use CCMC SWPCTEST runs with 12 virtual stations for 6 events spanning 2001–2011.

Why this matters: Ground magnetometers can only measure the total. The simulation lets us see which current systems create spatial structure and which destroy it. This is the key to understanding why ground-measured spatial coherence is so much weaker than the driving structure.

GPS TEC: Ionospheric Electron Density

CODE (Center for Orbit Determination in Europe) produces Global Ionosphere Maps (GIMs) from dual-frequency GPS observations, providing vertical total electron content (VTEC) on a 2.5° latitude × 5° longitude grid (71 × 73 cells) at 2-hour cadence in the IONEX format.

TEC measures the column-integrated electron density through the ionosphere — fundamentally a different observable than δB. While magnetometers see current structure, TEC sees density structure. The two are connected through ionospheric electrodynamics: FAC closure currents heat the ionosphere, driving density redistribution through enhanced recombination and plasma transport.

We have IONEX data for 1998–2006 and 2012–2016, giving us excellent overlap with both SuperMAG (continuous) and SWMF (6 events in 2001–2011).

4. The Comparable Buckets Problem

Comparing Moran's I across three different data sources requires aligning them in time, space, and observable. Each axis presents a distinct challenge:

SuperMAG 1-min native ... 1440 samples/day ... ↑ 2-hour median bins (12/day) ↑ SWMF ~1-min native ... ~1700-2800 timesteps/event ... ↑ 2-hour mean bins (12/day) ↑ GPS TEC 2-hour native already 2-hour cadence → ↑ Native 2-hour epochs (13/day) ↑ Comparable 2-hour buckets

Figure 4. Temporal alignment strategy. SuperMAG and SWMF operate at ~1-minute cadence; TEC at 2-hour. We aggregate SM and SWMF into 2-hour bins for three-way comparison, while retaining the native 1-minute cadence for the SM–SWMF pair.

Temporal alignment

SuperMAG: 1-minute. SWMF: ~1-minute (variable). TEC: 2-hour. For three-way comparison, we aggregate to the coarsest cadence (2 hours), using median for SuperMAG (robust to outliers) and mean for SWMF. For the SuperMAG–SWMF pair, we retain 1-minute resolution.

Spatial alignment

Two parallel comparison modes handle the spatial mismatch:

Observable alignment

δB (nT) and TEC (TECU) are fundamentally different quantities. Moran's I normalizes out amplitude (it's invariant to linear transformations), so the values are comparable as measures of spatial pattern regardless of the physical units. An I=0.3 in dB and I=0.3 in TEC both mean "moderate positive spatial autocorrelation" — nearby locations are more similar than chance would predict.

5. The Pipeline

SuperMAG NPZ loader_supermag.py SWMF .mag loader_swmf.py CODE IONEX loader_tec.py Event Catalog event_catalog.py Spatial Stats spatial_stats.py unified_morans_pipeline.py Per-event: load → align → compute I → save Cross-event: correlations → scaling → figures Per-Event .npz I_sm, I_tec, I_swmf scaling curves, correlations Cross-Comparison category averages, pairwise r cross_comparison.npz Figures overview, timeseries scaling, category boxplots

Figure 5. Pipeline architecture. Four loader modules handle data heterogeneity; a shared spatial statistics module provides canonical Moran's I; the orchestrator runs per-event analysis and cross-event comparison.

Event Catalog

We analyze 24 event days across four geomagnetic activity categories:

CategoryEventsDst RangeExample
Major storm9−422 to −105 nTHalloween 2003 (Dst = −383)
Moderate storm9−155 to −72 nTAug 2005 (Dst = −131)
Quiet4−10 to −3 nTSummer 2014 (Dst = −3)
Substorm-active2−45 to −30 nTJan 2014 (Dst = −30)

Source availability varies by event: 4 events have all three sources (triple overlap: SWMF + SM + TEC), 2 have SWMF + SM, and the remainder have SM + TEC. The event catalog automatically verifies data availability across all sources before processing.

Per-Event Processing

For each event, the pipeline computes:

  1. SuperMAG: 1-min and 2-hour Moran's I for N-component and horizontal magnitude (√(N²+E²))
  2. TEC grid: Queen-contiguity Moran's I on 50°–75°N band at native 2-hour cadence
  3. TEC at stations: Interpolated TEC at SuperMAG positions, same inverse-distance weights
  4. SWMF: Moran's I for all 5 components (total, MHD, FAC, Hall, Pedersen) × 2 polarizations
  5. Scaling analysis: Subsample SuperMAG stations (N = 6, 8, 10, 12, 15, 20, 25, 30, 40), 30 trials

All results are saved as compressed NumPy archives (.npz) with standardized keys for downstream analysis.

6. Results: Storm Intensity and Spatial Coherence

Spatial coherence by category

Figure 6. SuperMAG spatial coherence (2-hour Moran's I) by storm category. Major storms show clear positive autocorrelation; quiet days are near zero or negative. Individual events shown as jittered points.

Finding 1: Spatial coherence tracks storm intensity. Mean Moran's I by category: major storms = +0.20, moderate storms = +0.08, quiet = −0.06, substorm-active = −0.08. The magnetosphere-ionosphere system becomes more spatially organized as driving intensifies.

This is the expected behavior for a driven dissipative system: weak driving produces localized, incoherent fluctuations; strong driving creates large-scale organized patterns. The transition occurs around Dst ≈ −100 nT, where Moran's I consistently crosses zero from negative to positive.

Four-panel overview

Figure 7. Four-panel overview. Top-left: SM coherence vs Dst, color-coded by category. Top-right: TEC grid I vs SM station I. Bottom-left: SWMF decomposition bars. Bottom-right: Station count sensitivity curves.

The SM–Dst Relationship

Panel (a) of Figure 7 shows a clear trend: the most intense storms (Dst < −300 nT) produce the highest spatial coherence (I = 0.2–0.4). But the relationship isn't linear — some moderate storms achieve high coherence while the most extreme (Halloween 2003, Dst = −383) shows I ≈ 0.30, not the maximum. This suggests that storm geometry (e.g., the spatial extent and orientation of the electrojets) matters as much as raw intensity.

Detailed Timeseries: Halloween 2003

Halloween 2003 timeseries

Figure 8. Halloween 2003 Moran's I timeseries across all three sources. (a) SuperMAG 1-min with 30-min running mean, (b) SWMF decomposition showing FAC dominance, (c) TEC grid vs TEC-at-stations comparison.

The Halloween 2003 event illustrates several key features:

7. The SWMF Decomposition: FAC-Hall Cancellation

Field-Aligned Currents I ≈ +0.15 Large-scale R1/R2 system Creates coherent spatial pattern + Hall Currents I ≈ 0.00 Local ionospheric closure Destroys large-scale structure = Total δB I ≈ 0.00 Cancellation! Ground sees ~noise The Cancellation Problem FAC creates the large-scale magnetospheric structure that drives coherent ground perturbations. Hall currents, flowing locally in the ionospheric E-region, produce δB that partially cancels the FAC signal. Ground magnetometers measure the total — the sum after cancellation — making the coherent structure harder to detect. Only by decomposing via simulation (Biot-Savart) can we see the hidden spatial structure in the FAC component.

Figure 9. The FAC-Hall cancellation mechanism. Field-aligned currents create large-scale spatial structure; Hall currents locally cancel it. Ground magnetometers see only the residual.

Finding 2: FAC-Hall cancellation. Across all 6 SWMF events, the FAC component consistently shows I ≈ +0.10 to +0.19 (spatially coherent), while the Hall component shows I ≈ −0.01 to +0.04 (noise-level). The total δB shows I ≈ −0.05 to +0.01 — near zero despite the strong FAC structure.
EventI(total)I(FAC)I(Hall)I(Pedersen)
Halloween 2003−0.029+0.192+0.021~0
Aug 2001+0.010+0.075+0.040~0
Aug 2005−0.018+0.103−0.005~0
Dec 2006−0.050+0.118−0.001~0
Apr 2010−0.029+0.105+0.004~0
Aug 2011−0.034+0.135−0.006~0

Physical Interpretation

Field-aligned currents form the Region 1 / Region 2 system — a large-scale pattern driven by magnetospheric convection. This pattern spans thousands of kilometers and connects dawn-dusk asymmetry in the magnetosphere to the high-latitude ionosphere. It is inherently spatially coherent.

Hall currents, by contrast, flow locally in the ionospheric E-region (~110 km altitude) as horizontal closure currents. They respond to the local electric field and conductance, creating structure on smaller scales that partially cancels the large-scale FAC signal when projected to the ground.

The cancellation is not accidental. It's a direct consequence of how FAC close through the ionosphere: the downward current must return upward through ionospheric horizontal currents (Hall + Pedersen). The Hall component flows perpendicular to the driving electric field, creating a δB signal that partially opposes the FAC δB at the ground. This is Lenz's law in an ionospheric context — the induced currents resist the change.

This has profound implications for ground-based studies: the spatial coherence visible at the ground is significantly less than the actual magnetospheric driving structure. Ground magnetometers are not wrong — they accurately measure the total δB — but the total carries less spatial information than its largest constituent.

8. Station Count Sensitivity

Station count sensitivity

Figure 10. Moran's I as a function of the number of SuperMAG stations used. Each curve represents one event; error bars show trial-to-trial variability from random subsampling. The N=25 threshold marks where coherence estimates stabilize.

Finding 3: N ≥ 25 stations required for reliable Moran's I. Below N ≈ 15, the sampling error is comparable to the signal. At N = 12 (the SWMF station count), even the strongest storms show I ≈ 0.1–0.2 — substantially less than the I ≈ 0.3–0.4 observed at N = 30–40.

The scaling curves show two regimes:

This explains why SWMF's 12 virtual stations show I ≈ 0 for the total component even during intense storms: it's a combination of FAC-Hall cancellation and inadequate spatial sampling. The scaling analysis lets us disentangle the two effects — at N = 12, even pure FAC (no cancellation) would show I ≈ 0.1 rather than the I ≈ 0.2 we'd measure with 40 stations.

Correction Factors

The scaling curves provide empirical correction factors: if you observe I = 0.18 at N = 12 stations during Halloween 2003, the full-network value (N = 40) is I = 0.31 — about 1.7× higher. These correction factors are event-dependent (stronger storms have steeper scaling curves because there's more large-scale structure to resolve), but the general rule is:

I_corrected ≈ I_observed × (1 + 0.4 × log₂(N_full / N_observed))

This is an empirical approximation; the actual correction should use the full I(N) curve for each event.

9. TEC: The View from Above

Grid-Based vs Station-Based

TEC Moran's I reveals a striking contrast depending on the spatial sampling strategy:

MethodMean IRangeInterpretation
Grid (50°–75°N, queen contiguity)0.950.93–0.98Inherently smooth field
Station-based (inverse distance)0.300.02–0.66Comparable to SuperMAG
Finding 4: TEC grid Moran's I is always high because the GIM is produced by spherical harmonic fitting — it's smooth by construction. But TEC sampled at SuperMAG station positions shows values comparable to ground δB (I ≈ 0.3), confirming that the spatial sampling geometry dominates the measured coherence.

Interestingly, quiet days show slightly higher TEC grid I (0.97) than storm days (0.94). This makes physical sense: during quiet times, the TEC field is dominated by smooth solar-controlled ionization with a simple day-night gradient. Storms disrupt this smoothness by driving irregular density enhancements (storm-enhanced density, or SED) and depletions (negative storm effects), creating local structure that slightly reduces the overall spatial autocorrelation.

TEC–SuperMAG Correlation

The Spearman correlation between TEC-at-stations Moran's I and SuperMAG Moran's I at 2-hour cadence is weak and variable across events (r = −0.66 to +0.60, median ≈ 0). This suggests that while both respond to storm driving, they track different aspects of the M-I system:

The two can decouple because TEC responds to processes (e.g., neutral composition changes, diffusion) that operate on longer timescales than the current systems driving δB.

10. Physical Interpretation

The M-I System as Pattern Formation

Returning to the Busse & Kramer framework: the magnetosphere-ionosphere system exhibits classic behavior of a driven dissipative continuous system:

  1. Below threshold (quiet: Dst > −30 nT): No large-scale organization. Moran's I ≈ 0 or negative. The system is subcritical — local fluctuations don't couple into coherent patterns.
  2. Above threshold (storms: Dst < −100 nT): Emergence of large-scale patterns. Moran's I ≈ 0.2–0.4. The driving (solar wind Bz < 0) exceeds the critical threshold for coherent convection patterns, and the R1/R2 FAC system organizes the high-latitude ionosphere.
  3. Strong driving (extreme: Dst < −300 nT): Patterns are intense but not necessarily more coherent than moderate storms. I plateaus around 0.3–0.4 even as amplitude increases, suggesting a saturation in the spatial organization even as the amplitude continues to grow.
Amplitude vs. structure: A key insight from this pipeline is that spatial coherence (Moran's I) and amplitude (|δB|) are not the same thing. A storm can drive enormous δB values at individual stations while maintaining relatively modest spatial coherence, if the perturbations are localized rather than large-scale. Conversely, a moderate but spatially extensive storm can show high I with modest amplitudes.

What Creates Structure?

The SWMF decomposition provides the answer hierarchy:

  1. FAC (Region 1/2 system) — primary source of large-scale spatial structure (I ≈ 0.10–0.19). Driven directly by magnetospheric convection, this is the pattern-forming mechanism.
  2. MHD (ring current, etc.) — contributes smooth large-scale background but varies slowly, contributing little to spatial pattern on station-separation scales.
  3. Hall — locally generated, partially cancels FAC structure at the ground. This is the key destroyer of observable coherence.
  4. Pedersen — weak, little spatial pattern.

The Observability Gap

This decomposition reveals a fundamental observability gap: the most physically meaningful spatial structure (FAC, driven by magnetospheric dynamics) is partially hidden from ground magnetometers by ionospheric closure currents. Ground-based Moran's I of ~0.3 during major storms represents the residual coherence after cancellation, not the full structure. The FAC alone shows I ≈ 0.19 at N = 12 stations — which, corrected for station-count effects, would be I ≈ 0.30 at N = 40. The true magnetospheric structure is more organized than the ground can reveal.

11. Future Directions

Higher-resolution TEC

The 2-hour/2.5°×5° CODE GIMs are the most accessible global TEC product, but higher-resolution alternatives exist: MADRIGAL provides 1°×1° maps at 5-minute cadence using GPS phase observations. These would better resolve storm-time TEC structure and enable more meaningful comparison with the 1-minute SuperMAG cadence.

AMPERE: A True Fourth Spatial Leg

The Active Magnetosphere and Planetary Electrodynamics Response Experiment (AMPERE) derives field-aligned current maps from the Iridium constellation's engineering magnetometers. This provides a direct observation of FAC spatial structure — the very quantity we infer from SWMF decomposition. AMPERE data from 2010–present would overlap with our 2012–2016 SuperMAG+TEC events and provide the missing observational constraint on FAC coherence.

GAMERA: Next-Generation Simulation

GAMERA (Grid Agnostic MHD for Extended Research Applications) replaces BATS-R-US with a sixth-order numerical scheme that dramatically reduces numerical diffusion. If GAMERA preserves more small-scale structure in FAC, we'd expect higher Moran's I in the FAC component and possibly different cancellation behavior. This is a direct test of whether the FAC-Hall cancellation we observe is physical or partially numerical.

Multi-Scale Analysis

Moran's I with a distance cutoff can probe different spatial scales. By sweeping the cutoff from 500 km to 5000 km, we can build a Moran correlogram — the analog of a variogram in geostatistics — revealing the characteristic scale of spatial organization in each source. This connects directly to the correlation length in Busse & Kramer's pattern formation theory.

Temporal Dynamics

How does spatial coherence evolve through a storm? Our 1-minute SuperMAG data could reveal whether coherence builds gradually, appears suddenly at onset, or oscillates with substorm cycles. The ~30-minute modulation visible in the Halloween 2003 timeseries (Figure 8a) hints at substorm-scale organization.


Summary of Key Findings

#FindingImplication
1SM spatial coherence tracks storm intensity
(major: I=+0.20, quiet: I=−0.06)
The M-I system shows classic driven-dissipative pattern formation
2FAC creates structure (I≈+0.15); Hall destroys it;
total ≈ 0
Ground magnetometers see only residual coherence
3N ≥ 25 stations needed for reliable Moran's I SWMF's 12 stations underestimate coherence by ~1.7×
4TEC grid I always ~0.95 (smooth by construction);
TEC at stations I ≈ 0.30 (comparable to SM)
Spatial sampling geometry dominates the coherence measurement

Generated by the unified Moran's I pipeline · 24 events · 3 data sources · May 2026
Pipeline: scripts/unified_morans_pipeline.py · Results: results/unified_morans/