An issue affecting some customers was identified by our monitoring systems at 16:15 – this has been traced back to a switch failure at our UWSP POP. The faulty switch has now been isolated from the network and an engineer is en route to replace it.
Customers at the Venture Centre on the UWSP will continue to experience issues whilst the switch is offline. This issue had a knock-on effect to some customers on the Westwood Business Park; an engineer is en-route to reboot the DSLAM feeding this site. Multi-homed customers at Westwood should already have service restored.
All other customers should now be back online – we will update this post with more information as we get it, including mitigation steps to prevent a re-occurrence of this issue.
UPDATE [17:30] – All customers at Westwood Business Park should now have full restoration of service. Our engineer has also arrived on site at UWSP to replace the failed switch there.
UPDATE [18:45] – The faulty switch has been replaced and all services restored. If you continue to experience problems, please contact a member of the support team on 02476 997 222 or firstname.lastname@example.org. We are working on implementing rate limitation on core interfaces to prevent a reoccurrence of this unusual issue.