We're currently investigating network outages reported in our Netherlands facility. Appropriate engineers are being engaged at this time.
** No customer data is at risk, all servers are powered and operational, this is a network event only **
These updates have been pulled from broader conversations below. Both redundant uplinks provided to KnownHost in the Netherlands facility have gone offline. This has stemmed from a power event in a completely separate facility which powers the core networking equipment for our uplink provider.
1:12 AM - We've been given confirmation that all equipment, including upstream equipment within all DRT facilities is functioning properly, however we've been told this may be tied to a "Power Event" at Equinix AMS1 where apparently all of the public uplinks feed from.
1:34 AM - It appears that the root issue is being worked on now, or at least isolated to the core equipment located in Equinix AM1 facility.
2:35 AM - Equinix Data Center confirmed they are doing a power maintenance at the site but the issue is one of the PDUs. We are working on restoral options at this time.
2:47 AM - The problem has been isolated down to a PDU failure in combination with Equinix performing power maintenance on one of the feeds.
2:57 AM - Update that PF are working on getting temporary power to bring up the critical equipment which will bring us online. Very very rough ETA of 1~3 Hours
3:10 AM - Quick update, a plan has been formulated and sent to Equinix, their basically reliant on their remote hands to rectify the situation.
In theory it's only 5-10 minutes of work (swap the power feeds between the bad/good PDU's) but simple things are never quite simple with remote hands as the request was put in to them about 20~ mins ago according to PF.
4:02 AM - Connectivity restored, system services coming back online.
** No customer data is at risk, all servers are powered and operational, this is a network event only **
These updates have been pulled from broader conversations below. Both redundant uplinks provided to KnownHost in the Netherlands facility have gone offline. This has stemmed from a power event in a completely separate facility which powers the core networking equipment for our uplink provider.
1:12 AM - We've been given confirmation that all equipment, including upstream equipment within all DRT facilities is functioning properly, however we've been told this may be tied to a "Power Event" at Equinix AMS1 where apparently all of the public uplinks feed from.
1:34 AM - It appears that the root issue is being worked on now, or at least isolated to the core equipment located in Equinix AM1 facility.
2:35 AM - Equinix Data Center confirmed they are doing a power maintenance at the site but the issue is one of the PDUs. We are working on restoral options at this time.
2:47 AM - The problem has been isolated down to a PDU failure in combination with Equinix performing power maintenance on one of the feeds.
2:57 AM - Update that PF are working on getting temporary power to bring up the critical equipment which will bring us online. Very very rough ETA of 1~3 Hours
3:10 AM - Quick update, a plan has been formulated and sent to Equinix, their basically reliant on their remote hands to rectify the situation.
In theory it's only 5-10 minutes of work (swap the power feeds between the bad/good PDU's) but simple things are never quite simple with remote hands as the request was put in to them about 20~ mins ago according to PF.
4:02 AM - Connectivity restored, system services coming back online.
Last edited:
