09:43	Our 2^nd line team together with engineer's onsite at our Brick lane POP are currently investigating. BT is also investigating and we expect an update very shortly.
10:24	Testing with BT did not resolve the issue. An Easynet engineer is conducting physical checks between the BT/Easynet equipment and will provide an update shortly.
11:21	BT has found a fault on their network and their engineers are currently investigating. Our engineers are expecting an update from BT shortly.
12:23	Following further testing, we have eliminated any possible issue on Easynet's network. BT has identified where failure has occurred and a field engineer is investigating. The BT engineer will call Easynet shortly with an update.
14:05	This is an interim update regarding today's Major Service Outage of the BT Megastream Ethernet Service. This affected all E2BN LAs with the exception of Norfolk, Milton-Keynes and the Essex Siemens schools network. I have been informed that the fault was due to a hardware failure in the BT London Network and that service was restored at around 13:20pm today.
14:14	A BT engineer was able to resolve the fault by swapping the port on their equipment in the Docklands. We are now able to see all the sites up and are able to ping each site and have been stable since fault was resolved. We will monitor sites until close of business.

Incident Report

The following incident report was received from EasyNet:

Incident Description	Multiple Sites Down: Cambridge, Thurrock, Essex , Peterborough , Bedfordshire, Luton Borough Council-Schools, Suffolk , Hertfordshire, Luton Borough Council Corporate and Southend
Cause of Incident	The incident was caused by faulty port on a device in the Docklands within the BT network.
Solution/ Actions taken	Easynet investigated and reported a link failure to BT. Following further testing a BT field engineer was dispatched to their Docklands datacenter and swapped the faulty port. All sites became visible on our monitoring system and the sites pingable again.
Preventive action(s) and/or Follow Up Investigation	We do not expect any further issues and will continue to monitor until close of business.

Easynet Resolution		BT resolved fault.
Date & Time Ticket Opened		21/11/2007 05:32:01
Date & Time Ticket Closed		Still pending in monitoring status. Will close at end of business today.
Escalations Performed		BT's E2BN Management was aware of issue and assisted when necessary.
Comments:	Easynet sincerely apologises for the impact this has caused on your business.

E2BN Urgent Network Changes

Purpose: Plan to alleviate core firewall issues and improve reliability

Audience: Headteachers, ICT Teams

Summary:

E2BN are planning to make changes to the core network on Monday 26^th November 2007 at 11:00 hours.

There is likely to be a brief interruption in WWW browsing at this time.

The system will be monitored carefully at this time; any problems experienced will cause an immediate rollback to the original configuration.

Technical Detail:

The following information is directly from E2BN

At the meeting that took place with E2BN and Easynet on 29th October it was proposed that to mitigate further service issues related to the E2BN firewall, it would be prudent to offload all Protex web traffic onto a pair of dedicated Cisco 7301 NAT routers. These routers are already handling traffic from the core Protex systems available to Libraries across the region.

As you know there have been further problems with the E2BN firewall this week already. E2BN feel that to safeguard service we need to act as soon as possible to implement the change. We have put in place a plan for moving the traffic over and have arranged with Easynet that this can take place on MONDAY 26TH NOVEMBER. Availability of Easynet expert resource dictates that this activity be scheduled in across a single working day from 08:30am onwards so that subject to service level monitoring, PROTEX TRAFFIC from all LAs will have migrated by 18:00pm.

The schedule of changes is proposed as follows:

08:00 Easynet begin configuration work - no changes applied.

08:30 - 09:00am Luton change over. Monitoring of service by LA, E2BN and Easynet. If all ok then:

10:00 - Bedfordshire

11:00 - Cambridgeshire

12:00 - Southend

13:00 - Essex - Braham Street

14:00 - Suffolk

15:00 - Thurrock

16:00 - Peterborough

17:00 - Hertfordshire

The performance of the core router and NAT routers will be monitored throughout. No LA will be change over until the previous one has been assessed as ok. If problems are encountered at any stage then the change will be rolled back immediately by removing the policy-routing from the individual VLANs.

There will be a very brief interruption to browsing via Protex during the changeover - a routing policy will be applied to the E2BN core router on the VLAN interface associated with each LA. This policy will force Protex traffic to the NAT routers where a new NAT address will be applied to outbound traffic. All other traffic will continue route as normal.

Public IP hide addresses have been allocated as follows:

85.12.64.149 Beds

85.12.64.150 Cambs

85.12.64.151 Southend

85.12.64.152 Suffolk

85.12.64.153 Peterborough

85.12.64.154 Thurrock

85.12.64.155 Luton

85.12.64.156 Essex Braham Street

85.12.64.157 Herts