Massive computer failure wipes out 5 terabytes of data at town hall, and there’s no back up (!)
A trove of electronic records that includes some 11,000 beach card renewal applications was lost over the weekend after a series of hard drive failures sustained by the town of Greenwich’s computer network, according to local officials, who are now scrambling to try to restore the precious data.
“Unfortunately, we have to rebuild the system from scratch and it will take some time,” said Boris Hutorin, the town’s information technology director.
Hutorin estimated that 5 terabytes of data — that’s 5 trillion bytes in layman’s terms — was wiped out as a result of what he characterized as an extremely rare occurrence.
Asked to elaborate on what the town meant by compromised, [Parks Director] Siciliano said, “Not there, OK.”
All data entered by the parks department from Feb. 27 to date is unrecoverable, according to Siciliano, who said his office is having to pay out overtime to its full-time employees and additional hours to temporary workers to help sift through hard copies of the information that was lost.
The Griffith Harris Memorial Golf Course has resorted to taking reservations for tee times manually as a result of the situation, Siciliano said.
Hutorin characterized the problem as a fluke hardware failure that he said affected multiple storage area networks both Saturday and Sunday in the computer room at Town Hall.
Saturday’s hard drive failure resulted in a minimal loss of data, according to Hurtorin, who said that consecutive crashes on Sunday are to blame for the larger problem.
“The system is designed to work around this kind of failure,” Hutorin said.
While the first hard drive was being replaced on Sunday and the data was being “rebuilt,” a second hard drive failed, Hutorin said.
“It’s almost impossible to have this happen,” Hutorin said.
“Almost impossible”, obviously, isn’t the same thing as ”impossible”. Do you suppose Hutorin has tenure?
UPDATE: Reader “Georgie” asks whether our Boris is the same Greenwich IT guy who was using town computers (and town time) to surf porn sites. Don’t know, but the porn site in question was written entirely in Russian. Now, maybe Boris Hutorin has hired other Russians to work for him in the IT department and they’re the ones enjoying pictures of dirty Russian girls (can we still call them sluts, or is that now off limits?) , or maybe he’s the only commie down there in the basement. If Peter Tesei knows, he ain’t talking.