ForecastAdvisor Weather Forecast Accuracy Blog

A Blog Documenting the Intersection of Computers, Weather Forecasts, and Curiosity
 Subscribe in a reader    Subscribe by email:   Delivered by FeedBurner


December 12, 2005

Home Field Advantage

Do weather forecasters do better forecasting their "local" area than a distant city, all other things being equal? Does being "local" improve a weather forecast? These are questions I occasionally hear, and I've heard both sides. Proponents say that knowing the quirks of local weather help a forecaster improve his or her forecast, and that the only way a forecaster can learn about those quirks is by living it. Opponents say that computers do much of the work of forecasting, and that weather works on a large enough scale that the location of the actual forecaster doesn't much matter.

I thought I would look at the ForecastWatch database to see if it could help me answer the question. ForecastWatch collects data on over 800 U.S. and international cities for the major forecasters: Accuweather (located in State College, PA), Weather Channel (located in Atlanta, GA), CustomWeather (located in San Francisco, CA), Intellicast (located in Andover, MA), and the National Weather Service, with many centers around the U.S. Intellicast and The Weather Channel are owned by the same company.

I decided to look at one- to three-day out high temperature forecast accuracy for all of this year, so far. There were 800 U.S. cities where accuracy was calculated. Each forecaster was ranked in order of the total high temperature error for the forecasts. The National Weather Service came in first with 252 cities out of the 800. That means the NWS had the lowest average absolute error in high temperature forecasting this year (2005, through October) in 252 cities. Next was The Weather Channel with 248, Intellicast with 125, Accuweather with 122, and finally CustomWeather with 53 cities.

But that's not real informative. What we really want to see is who won each of the forecasters "home" states. Accuweather was founded and has deep roots in State College, Pennsylvania. Many of its meteorologists came up through the renowned Penn State meteorology program. If there is a "local" advantage to meteorology, Accuweather should have it for Pennsylvania. And indeed that is the case. Of the 23 cities tracked in Pennsylvania, Accuweather came out on top with the least error for 15 of those cities. So while Accuweather came out on top in only 15%% of the cities nationwide, it won 65%% of the cities in Pennsylvania. Accuweather also came out on top in neighboring Maryland, and tied with Weather Channel in New Jersey.

How about The Weather Channel? Headquartered in Atlanta, and with most of their meteorological staff there, would they come out tops in Georgia? They do! While they get the blue ribbon in 31%% of the states overall, they come out on top in about half the cities in Georgia, and lead all providers with 8 of the 17 cities tracked (NWS is next with 5). So it looks like they have a home field advantage as well.

Intellicast should win Massachusetts then, right? Wrong. It does rather poorly there, and also in New Hampshire, which is close to their headquarters in Andover. They are owned by the same company as The Weather Channel. Perhaps there is little local meteorological support in Andover? Or maybe there really isn't a "local" weather advantage. Maybe the statistics are just coincidental.

Let's look at CustomWeather, then. CustomWeather is the smallest of the tracked forecasters, but is very competitive in a lot of statistics. Unfortunately, they only led in less than 7%% of the cities, and didn't win their home state of California. But wait...they dominate Alaska and Hawaii, states probably forgotten about by the east coast forecasters. CustomWeather won 75%% of Alaska's 18 tracked cities, and 80%% of Hawaii's five. In fact, 24 of the 53 cities CustomWeather came out on top in (almost half) are in Alaska, Hawaii, and California. Not home field advantage, but pretty close.

United States map showing where weather forecasters had the most sites ranked number one in high temperature accuracy for one to three days out

(Click here for a larger version)

I don't think this data proves anything, but it is interesting. Maybe there is something to the assertion that being local gives weather forecasters an edge.



December 2005   January 2006   March 2006   June 2006   July 2006   August 2006   September 2006   October 2006   November 2006   December 2006   January 2007   February 2007   March 2009   September 2009   March 2010   April 2010   February 2011   April 2011   June 2011   February 2012   September 2012   June 2013   October 2013   February 2014   June 2016   Current Posts