one of the buoy loggers misset to local Cayman/Miami time

[This post was created in January/2015 but back-dated to the time of the incidents described.]

On November 7th, 2014, I noticed that the CCMI2 buoy's two dataloggers were running on different time zones.  The "met" logger continued to (correctly) operate in UTC but the "main" logger was running five hours behind, which coincided with local time at the Little Cayman Research Centre and here at AOML in Miami.  Regarding the only other servers known to connect to these loggers, those of YSI, I'm not sure where they are located or what time zone they run in.

The reset happened on Wednesday, November 5th, at some time between 2:20pm and 2:30pm local Cayman/Miami time.

The most obvious explanation for this problem would be if someone had connected to the main datalogger from a computer running in this -0500 time zone whose local loggernet settings were configured to automatically "correct" the logger clock if it were found to be out of sync with the server.  This is not a default setting on loggernet but neither is it an uncommon setting for people to choose.

However, we were unable to identify any computer that might have reset this datalogger's clock.  Consider:

• Laura Wright reported, on November 12th, that their land-based servers were completely unable to connect to the station in any way:  "The antennae cable/connector end is literally broken. I'm waiting on parts to fix. There is only one computer on station that connects to the buoy via the antennae cable which is currently not connecting due to the cable issue and was the only computer connecting since July 14, 2014 when Rob transferred everything over before that previous computer died."
• The AOML loggernet server runs exclusively in UTC and anyway its settings were verified as not auto-correcting any loggers clocks even if they were found to be out of sync.
• Jon Fajans, on November 8th, suggested the possibility that the main datalogger might have reset its clock based on a time signal provided by the modem, since the modem likely "knows" what local Cayman time is.  However there is no known mechanism for the datalogger and modem to trade time information in this way.  The one bit of clock-sync code that used to exist, that which every hour reset the "met" logger clock using the "main" logger time, was in fact deleted in the last reprogramming because of problems it had caused at one of the Tobago sites.
• On November 12th, Matt Previte of YSI reported: "Verified that our Loggernet is not set to sync clock for Cayman."  He suggested asking CCCCC while saying that he didn't recall setting up the logger to call out to any servers but AOML's and YSI's.  I checked the programming and confirmed that there were no other callouts except for AOML and YSI, and did not pursue the matter further with CCCCC.

In the absence of any explanation for how the clock was reset in the first place, we decided that AOML would correct the time on the main logger through our IP/modem connection.  This was done at 2014/11/12 17:56:46 UTC.  Since then (as of January 2015) we have not noticed any further problems with either logger's clock.

The data from November 5th - 12th are all archived but all of their timestamps are wrong so they have not been loaded or integrated in any way.  Eventually I will write a simple script to correct the timestamps on those records so that this hole in the dataset can be patched.

Just to reiterate, we still have no theory about how the main logger's clock could have been changed on November 5th.

(signed)
Mike Jankulak

2014 Annual Maintenance

The 2014 annual maintenance of the Crews Buoy was completed this October by CCMI staff members Jon Clamp, Laura Wright and Lowell Forbes along with remote assistance from NOAA tech Mike Jankulak and field assistance from C-ARMS principal Jon Fajans.

 

The buoy was released from its mooring and towed to Salt Rock Dock on October 14 where it was lifted out onto our truck with the help of CB Power and Light. Once at the station the buoy was lifted off the truck and set down for maintenance. This included a thorough power washing and fresh bottom paint for the float ring. New zincs were attached as needed along with zip ties as well. The CTD was replaced after some programming issues were updated remotely by Mike Jankulak and was then launched and tested by Jon Fajans in Little Cayman (October 24 at 17:03 UTC). Our Bics were cleaned and left in place for another season due to their reliability. These will be replaced in 2015 or if and when needed during the coming year. A new RM Young Temp/RH sensor was also attached as this had failed earlier in the year (June 6). Jon Fajans completed an instrument test and all was pronounced operational.

 

Finally the buoy was given a pressure test on the battery and electronics housing and given the green light for redeployment. We launched the buoy on October 29 in a fresh Easterly breeze and had to manage the re-attachment of the buoy in less than optimal conditions however no problems were encountered. We were also glad to have the help on this leg by CCMI long time volunteer Greg Locher.

 

Although NOAA is receiving the data stream, CCMI has not received any data updates since redeployment.  We are currently working to resolve this issue.

Please view the video clip of the removal and still photos of the redeployment.