At 2:15AM EDT we began to experience a network disruption involving certain routes to the NY1 facility. Clients located in the NY1 facility as well as some NJ1 clients may have been affected by this disruption. The issue has just been mitigated by our network administrators and normal routing should return shortly.
Please feel free to open a ticket on the MyNYI helpdesk at /my.nyi.net if you are still experiencing issues. We thank you for your cooperation.
There was a network issue affecting some portions of the NJ infrastructure earlier this morning, shortly after 5:00 AM EDT.Â Any affected networks should have connectivity restored, and we continue to monitor for proper operation and performance.
Please feel free to open a ticket on the (757) 796-0941 atÂ if you have any questions or comments.
UPDATE 8/27: The cause of the packet loss is attributed to a large-scale DDoS attack which was mitigated. No further disruption is expected.
At approximately 8:29PM EDT on 8/21/18, our monitoring systems detected a line card failure on one of our core switches at the NJ1 facility. A replacement line card was installed at 8:44PM EDT, and the core switch is back to normal operation.
Some clients may have noticed a brief drop in ping monitoring during this time, due to routing reconvergence and failover of redundant uplinks.
Please feel free to open a ticket on the MyNYI helpdesk at /my.nyi.net if you have any questions or concerns about this emergency maintenance.
We are currently monitoring the winter storm expected to reach the Northeastern US over the next 24 hours. While we do not expect any significant impact to our operations, NYI is prepared with recently topped-off fuel tanks, augmented staff levels, and contingency plans in place for any unforeseen developments.
Travel to either the NJ1 or NY1 facilities may become difficult and unsafe as a result of the storm, so please feel free to engage our remote hands services for any planned maintenance.
Our provider is experiencing issues routing inbound calls due to a fiber cut upstream. They expect the issue to stabilize by the end of the day.
If you have trouble reaching NYI numbers, please open a case on our helpdesk at /www.my.nyi.net.Â If you provide a numberÂ we will call you back right away.Â We apologize for any inconvenience.
Due to the upcoming Nor’easter expected to affect the northeastern US, where NYI’s New York and New Jersey facilities are located, we have activated our Emergency Action Plan (EAP).
All generators have been tested according to schedule, and all sites are fully staffed, with contingency plans in place, in the event of staff being unable to travel to the facility. On site technicians will have abundant food and beverages available to keep working through the storm.
The Governors of New York and New Jersey have both declared states of emergency, in anticipation of the significant impact of this storm. There is no travel ban at this time. While it is possible for our clients to access our facilities during the storm, we would recommend staying home if at all possible. NYI’s remote hands services can be utilized for any planned work.
Please feel free to reach out to us at /my.nyi.net if you have any concerns.
We have been monitoring the weather forecasts, and have activated emergency preparations for the impending winter storm which is expected to affect the northeastern US.
All generators were tested this week, and fuel has been topped up at all sites. All sites are fully staffed, with contingency plans in place in the event of staff being unable to travel to the facility. On site technicians will have abundant food and beverages available to keep working through the storm.
Please feel free to reach out to us at /my.nyi.net if you have any concerns. Stay safe and warm!
At 10:35PM EDT on Sunday, August 7th, a hardware failure was observed on a redundant switch pair in the 999 Frontier Road (NJ1) facility. This may have caused a subset of single-homed clients to experience brief periods of latency or minor packet loss between 10:35PM and 2:30AM EDT. The issue was diagnosed during an emergency maintenance period, and it was found to be related to a faulty switch supervisor card. The card has since been replaced, restoring full redundancy to the network. If you have any questions, please feel free to reach out to our MyNYI helpdesk at /my.nyi.net.
A fiber cut in the Northeastern US has caused a number of connectivity issues for providers. We believe we have routed around the issue, but if you are still seeing any latency or packet loss when connecting to any of our facilities, please open up a ticket at /my.nyi.net so that we can look into assisting you further.
A maintenance window related to our ongoing network upgrades was scheduled at our 999 Frontier Road facility on the night of Sunday, April 24th. No service impact was expected, however the maintenance exposed a configuration error that affected some clients at 999 Frontier Road. Beginning at approximately 10:45 pm Eastern time, this configuration error caused certain routes to no longer be properly announced. The issue was corrected by 11:00 pm Eastern time, though there may have been residual effects beyond 11 pm.
Additional testing and safeguards to prevent a similar configuration error from going undetected have been put into place. No further issues are expected.