After about two hours of Operation can no longer connect to Weather Underground

  • 1
  • Problem
  • Updated 2 months ago
I have been successfully accessing Weather Underground for over two years, with the same hardware and the same software.

I make two connections every ten minutes, one to get current conditions and the other for the forecasts.  So, I am no where near the maximum connections allowed for my account.

A few days ago, I noticed lots of runs where no data was returned, followed, eventually by the inability to connect to the site.  Once that happened, I could no longer connect.

If I reset the microcontroller, it would start working again, but eventually fail.  The pattern was always the same, the first run was successful, the next several runs would not return forecast data, a successful run would ensue, followed by loss of data, then the inability to connect.  It always took about 1.5 hours to fail.  

I'm using an ESP 8266 microcontroller to access Weather Underground.  A replacement ESP 8266 performed exactly the same.  I tried a different personnel weather station as well.

The weather data from the ESP 8266 is sent to an ATMega 328P which runs my 90 column by 5 row LED display.  To reduce the component count to one (the ESP8266 is on a development board so is a complete unit), I isolated the ESP and sent the output to the serial port of my PC.  I  kept simplifying the software and trying other schemes to make the TCP/IP connection.   Nothing broke the failure pattern - always worked for the same length of time.

There was nothing in the system that was updated or changed. 

I must reiterate that this worked flawlessly for over two years.  I'm really at a loss here and desperately need some ideas to understand why this is happening.  Thanks.
Photo of Martin

Martin

  • 7 Posts
  • 0 Reply Likes

Posted 2 months ago

  • 1
Photo of joegr

joegr

  • 9 Posts
  • 6 Reply Likes
It's still working (at times) for me, but it has been pretty bad lately.  A lot of times it returns nothing.  I check for forecast about once an hour, and for radar about every 2.5 minutes.  It has gone for up to a day or two not working at all, but some days are nearly error free.  Overall, it seems to be getting worse.
Photo of Tim Roche

Tim Roche, Official Rep

  • 309 Posts
  • 28 Reply Likes
Hi martin, 

Can you send an error log and the APIs you are connecting to?
Photo of Martin

Martin

  • 7 Posts
  • 0 Reply Likes
Hi Tim.  Thanks for responding. 

I see that some people report error messages from the site, but I don't receive them.  My software acts like a browser, connecting to, and then downloading the ,json files.  

Today, so far, it has not stopped functioning.  I've been running for over 4.5 hours.  Last afternoon, it ran for 2 hrs. and 50 min. before the microcontroller just froze - something I never saw before, normal it resets itself.  That was actually one of my longer runs.


By API's I guess you mean the stations I connect to.  I am connecting to PWS KNCFEARR3.  I first discovered the problem connecting to KNCPITTS5.

I'm including the results so far today.  It has made 28 runs.  I have had no problem with loss of connectivity to the sites, and I have always received the current weather conditions.  However, please note that of the 28 runs, seven runs failed to return forecast data.  

If it does not continue to function, I will report back.


...
Connected to WiFi

--------------------------------------------
Run Number: 1
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 10:15 AM
weather: Mostly Cloudy
temperature: 76.3
relative humidity: 93%
winds: Calm
pressure: 30.20
feels like: 76.3
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 88F. Winds light and variable.

--------------------------------------------
Run Number: 2
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 10:25 AM
weather: Partly Cloudy
temperature: 76.1
relative humidity: 91%
winds: Calm
pressure: 30.20
feels like: 76.1
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 88F. Winds light and variable.

--------------------------------------------
Run Number: 3
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 10:35 AM
weather: Partly Cloudy
temperature: 76.6
relative humidity: 92%
winds: From the SSE at 1.8 MPH Gusting to 4.3 MPH
pressure: 30.20
feels like: 76.6
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 87F. Winds light and variable.

--------------------------------------------
Run Number: 4
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
***NO FORECAST DATA FROM HOST

measurement time: June 8, 10:45 AM
weather: Partly Cloudy
temperature: 77.2
relative humidity: 92%
winds: Calm
pressure: 30.20
feels like: 77.2
precipitation: 0.00

Forcast Period: No Data
Forecast: No Data

--------------------------------------------
Run Number: 5
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 10:55 AM
weather: Partly Cloudy
temperature: 77.5
relative humidity: 90%
winds: Calm
pressure: 30.20
feels like: 77.5
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 87F. Winds light and variable.

--------------------------------------------
Run Number: 6
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
***NO FORECAST DATA FROM HOST

measurement time: June 8, 11:05 AM
weather: Partly Cloudy
temperature: 77.7
relative humidity: 88%
winds: From the SSW at 1.8 MPH Gusting to 4.3 MPH
pressure: 30.20
feels like: 77.7
precipitation: 0.00

Forcast Period: No Data
Forecast: No Data

--------------------------------------------
Run Number: 7
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 11:15 AM
weather: Partly Cloudy
temperature: 77.7
relative humidity: 90%
winds: Calm
pressure: 30.20
feels like: 77.7
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 86F. Winds light and variable.

--------------------------------------------
Run Number: 8
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 11:25 AM
weather: Partly Cloudy
temperature: 78.1
relative humidity: 86%
winds: Calm
pressure: 30.20
feels like: 81
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 86F. Winds light and variable.

--------------------------------------------
Run Number: 9
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 11:35 AM
weather: Partly Cloudy
temperature: 78.4
relative humidity: 85%
winds: From the SW at 1.3 MPH Gusting to 5.6 MPH
pressure: 30.20
feels like: 81
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 86F. Winds light and variable.

--------------------------------------------
Run Number: 10
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 11:45 AM
weather: Partly Cloudy
temperature: 78.8
relative humidity: 83%
winds: Calm
pressure: 30.20
feels like: 82
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 86F. Winds light and variable.

--------------------------------------------
Run Number: 11
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 11:55 AM
weather: Partly Cloudy
temperature: 79
relative humidity: 85%
winds: Calm
pressure: 30.20
feels like: 83
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 86F. Winds light and variable.

--------------------------------------------
Run Number: 12
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 12:05 PM
weather: Partly Cloudy
temperature: 79.3
relative humidity: 82%
winds: From the SSW at 1.3 MPH Gusting to 5.6 MPH
pressure: 30.20
feels like: 83
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 87F. Winds light and variable.

--------------------------------------------
Run Number: 13
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
***NO FORECAST DATA FROM HOST

measurement time: June 8, 12:15 PM
weather: Partly Cloudy
temperature: 80.1
relative humidity: 83%
winds: From the SE at 3.8 MPH Gusting to 4.9 MPH
pressure: 30.20
feels like: 85
precipitation: 0.00

Forcast Period: No Data
Forecast: No Data

--------------------------------------------
Run Number: 14
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 12:25 PM
weather: Partly Cloudy
temperature: 80.4
relative humidity: 82%
winds: Calm
pressure: 30.19
feels like: 85
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 87F. Winds light and variable.

--------------------------------------------
Run Number: 15
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 12:35 PM
weather: Partly Cloudy
temperature: 80.2
relative humidity: 83%
winds: Calm
pressure: 30.19
feels like: 85
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 87F. Winds light and variable.

--------------------------------------------
Run Number: 16
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
***NO FORECAST DATA FROM HOST

measurement time: June 8, 12:45 PM
weather: Partly Cloudy
temperature: 80.2
relative humidity: 83%
winds: Calm
pressure: 30.19
feels like: 85
precipitation: 0.00

Forcast Period: No Data
Forecast: No Data

--------------------------------------------
Run Number: 17
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
***NO FORECAST DATA FROM HOST

measurement time: June 8, 12:55 PM
weather: Partly Cloudy
temperature: 80.6
relative humidity: 83%
winds: From the ENE at 1.8 MPH Gusting to 4.9 MPH
pressure: 30.19
feels like: 86
precipitation: 0.00

Forcast Period: No Data
Forecast: No Data

--------------------------------------------
Run Number: 18
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 1:05 PM
weather: Partly Cloudy
temperature: 81.1
relative humidity: 83%
winds: From the SSW at 1.3 MPH Gusting to 4.9 MPH
pressure: 30.18
feels like: 87
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 88F. Winds light and variable.

--------------------------------------------
Run Number: 19
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
***NO FORECAST DATA FROM HOST

measurement time: June 8, 1:15 PM
weather: Partly Cloudy
temperature: 81.3
relative humidity: 81%
winds: From the East at 4.9 MPH Gusting to 4.9 MPH
pressure: 30.18
feels like: 87
precipitation: 0.00

Forcast Period: No Data
Forecast: No Data

--------------------------------------------
Run Number: 20
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 1:25 PM
weather: Clear
temperature: 82
relative humidity: 79%
winds: From the ESE at 1.3 MPH Gusting to 4.9 MPH
pressure: 30.17
feels like: 89
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 88F. Winds light and variable.

--------------------------------------------
Run Number: 21
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
***NO FORECAST DATA FROM HOST

measurement time: June 8, 1:35 PM
weather: Clear
temperature: 82
relative humidity: 80%
winds: From the South at 2.5 MPH Gusting to 4.9 MPH
pressure: 30.17
feels like: 89
precipitation: 0.00

Forcast Period: No Data
Forecast: No Data

--------------------------------------------
Run Number: 22
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
***NO FORECAST DATA FROM HOST

measurement time: June 8, 1:45 PM
weather: Clear
temperature: 82.2
relative humidity: 81%
winds: Calm
pressure: 30.17
feels like: 90
precipitation: 0.00

Forcast Period: No Data
Forecast: No Data

--------------------------------------------
Run Number: 23
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 1:55 PM
weather: Clear
temperature: 82.9
relative humidity: 77%
winds: From the SE at 3.1 MPH Gusting to 4.9 MPH
pressure: 30.17
feels like: 90
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 87F. Winds light and variable.

--------------------------------------------
Run Number: 24
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 2:05 PM
weather: Clear
temperature: 84
relative humidity: 77%
winds: Calm
pressure: 30.16
feels like: 93
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 87F. Winds light and variable.

--------------------------------------------
Run Number: 25
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 2:15 PM
weather: Clear
temperature: 84.6
relative humidity: 74%
winds: From the SSW at 1.8 MPH Gusting to 4.9 MPH
pressure: 30.16
feels like: 93
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 87F. Winds light and variable.

--------------------------------------------
Run Number: 26
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
***NO FORECAST DATA FROM HOST

measurement time: June 8, 2:25 PM
weather: Clear
temperature: 84.7
relative humidity: 73%
winds: From the ESE at 1.8 MPH Gusting to 4.9 MPH
pressure: 30.16
feels like: 93
precipitation: 0.00

Forcast Period: No Data
Forecast: No Data

--------------------------------------------
Run Number: 27
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 2:35 PM
weather: Clear
temperature: 86.5
relative humidity: 72%
winds: From the SSW at 2.5 MPH Gusting to 4.9 MPH
pressure: 30.16
feels like: 97
precipitation: 0.00

Forcast Period: 
Forecast: 

--------------------------------------------
Run Number: 28
Attempting to connect for conditions
Connected Successfully for Conditions
Received Conditions Data From Host

Attempting to connect for forecasts
Connected Successfully for Forcastss
Received Forecast Data From Host

measurement time: June 8, 2:45 PM
weather: Clear
temperature: 85.8
relative humidity: 73%
winds: From the South at 1.3 MPH Gusting to 3.8 MPH
pressure: 30.15
feels like: 96
precipitation: 0.00

Forcast Period: Friday
Forecast: Partly cloudy. High 88F. Winds light and variable.
Photo of Tim Roche

Tim Roche, Official Rep

  • 309 Posts
  • 28 Reply Likes
I would make sure your code is handling errors properly, and making sure you don't crash in the event of a large response payload.  
Photo of Martin

Martin

  • 7 Posts
  • 0 Reply Likes
You are correct of course.  I stick the entire ,json file into a String, That is really a function, not a variable type.  There is no way to declare its size so if there is no terminating character to the .json file,  there is a good chance for a memory leak.  I did try replacing that methodology by reading line by line, but that not work any better and am not sure it would solve the original problem anyway.  I need to use a character array instead.  That will be the next stage in the development.