IDNetters Forums

Technical News & Discussion => IDNet Help => Topic started by: JB on May 27, 2011, 08:28:29

Title: Short Outage - Early Friday morning - Anyone else?
Post by: JB on May 27, 2011, 08:28:29
I'm just attempting to check if one of my routers is developing a problem.

Did anyone else have a short outage about 3.00am this morning (Friday 27th May)? Especially in the north west.

I realise this may have been local to me or even the router itself but I'd be interested to know if anyone else had similar.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: jameshurrell on May 27, 2011, 08:35:54
Yep I monitor three lines, two in shropshire, one in bedfordshire, all three had a short outage in the early hours. Looks like an idnet blip because there is a line on the same exchange in bedfordshire with a different isp that was unaffected.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Rik on May 27, 2011, 08:47:59
Are the lines 20CN or 21CN?
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Glenn on May 27, 2011, 08:56:41
I had the same in Berkshire
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Ray on May 27, 2011, 08:59:40
I had a brief loss of PPP at about 2:30am.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: tehidyman on May 27, 2011, 09:24:37
I am in Cornwall, presume this is the same phenomenon.

(http://www.thinkbroadband.com/ping/share-thumb/95ace5a904d5de225a2dc83d1f50db35.png) (http://www.thinkbroadband.com/ping/share/95ace5a904d5de225a2dc83d1f50db35.html)
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Ray on May 27, 2011, 09:35:01
Yes, that's exactly the same as my graph.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Glenn on May 27, 2011, 09:35:31
and mine too
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: dmgeurts on May 27, 2011, 09:53:44
Same here in Hertfordshire from 2:20 till 2:35AM. My own monitoring showed it wasn't BT as it could reach the IDnet PE (first hop outside my network when doing a traceroute). I'm suspecting IDnet had a routing issue last night.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Bill on May 27, 2011, 09:53:54
And another... South Oxon, FTTC.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: sobranie on May 27, 2011, 09:59:31
Ditto here on (01326)
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Bill on May 27, 2011, 10:05:05
Looking at the router log I get repeated instances of

  May 27 02:25:50  daemon  pppd[2622]: PPP: Start to connect ...
  May 27 02:25:50  daemon  pppd[2622]: PPP server detected.
  May 27 02:25:50  daemon  pppd[2622]: PPP session established.
  May 27 02:25:50  daemon  pppd[2622]: Using interface pppewan_1
  May 27 02:25:50  daemon  pppd[2622]: Connect: ppp_ewan_1 <--> eth0
  May 27 02:25:50  daemon  pppd[2622]: Couldn't increase MTU to 1500.
  May 27 02:25:50  daemon  pppd[2622]: Couldn't increase MRU to 1500
  May 27 02:25:50  daemon  pppd[2622]: Couldn't increase MRU to 1500
  May 27 02:25:50  daemon  pppd[2622]: PPP LCP UP.
  May 27 02:25:54  daemon  pppd[2622]: Remote message: CHAP authentication success, unit 4846
  May 27 02:25:57  daemon  pppd[2622]: Received bad configure-nak/rej:  03 06 d4 45 35 78 81 06 3e 06 26 7d 83 06 3e 06 26 7d
  May 27 02:26:00  daemon  pppd[2622]: Received bad configure-nak/rej:  03 06 d4 45 35 78 81 06 3e 06 26 7d 83 06 3e 06 26 7d
  May 27 02:26:03  daemon  pppd[2622]: Received bad configure-nak/rej:  03 06 d4 45 35 78 81 06 3e 06 26 7d 83 06 3e 06 26 7d
  May 27 02:26:06  daemon  pppd[2622]: IPCP: timeout sending Config-Requests
  May 27 02:26:06  daemon  pppd[2622]: Couldn't increase MTU to 1500.
  May 27 02:26:06  daemon  pppd[2622]: Couldn't increase MRU to 1500
  May 27 02:26:06  daemon  pppd[2622]: Connection terminated.
  May 27 02:26:06  daemon  pppd[2622]: Doing disconnect


Authentication server problem?
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: jameshurrell on May 27, 2011, 10:15:42
Quote from: Rik on May 27, 2011, 08:47:59
Are the lines 20CN or 21CN?

Hi Rik, two lines are 20CN and one is 21CN. All had the outage.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: dmgeurts on May 27, 2011, 10:18:12
Looking at my PPPoE logs I noticed the following:

ppp: [wan_link0] Name: "bras-red10.l-nws"

instead of:

ppp: [wan_link0] Name: "telehouse-gw4"

Next to that I saw that while my PPPoE connection bounced a few times I was given wrong IP addresses. Incidentally the IP address I was given belongs to BT (ripe query on 81.146.178.2) (http://www.db.ripe.net/whois?form_type=simple&full_query_string=&searchtext=81.146.178.2&do_search=Search). So all in all something went wrong on IDnet's or BT's network (or the Radius realm forwarding) disrupting the connectivity to IDnet's gateway machines, hence connecting me to BT's network instead:

May 27 01:23:35 ppp: [wan] 172.16.68.167 -> 81.146.178.2
May 27 01:23:35 ppp: [wan] IPCP: LayerUp
May 27 01:23:35 ppp: [wan] IPCP: state change Ack-Sent --> Opened
May 27 01:23:35 ppp: [wan] IPADDR 172.16.68.167
May 27 01:23:35 ppp: [wan] IPCP: rec'd Configure Ack #7 (Ack-Sent)
May 27 01:23:35 ppp: [wan] IPADDR 172.16.68.167
May 27 01:23:35 ppp: [wan] IPCP: SendConfigReq #7
May 27 01:23:35 ppp: [wan] 172.16.68.167 is OK
May 27 01:23:35 ppp: [wan] IPADDR 172.16.68.167
May 27 01:23:35 ppp: [wan] IPCP: rec'd Configure Nak #6 (Ack-Sent)
May 27 01:23:35 ppp: [wan] IPADDR 0.0.0.0
May 27 01:23:35 ppp: [wan] IPCP: SendConfigReq #6
May 27 01:23:35 ppp: [wan] COMPPROTO VJCOMP, 16 comp. channels, no comp-cid
May 27 01:23:35 ppp: [wan] IPCP: rec'd Configure Reject #5 (Ack-Sent)
May 27 01:23:35 ppp: [wan] IPCP: state change Req-Sent --> Ack-Sent
May 27 01:23:35 ppp: [wan] IPADDR 81.146.178.2
May 27 01:23:35 ppp: [wan] IPCP: SendConfigAck #183
May 27 01:23:35 ppp: [wan] 81.146.178.2 is OK
May 27 01:23:35 ppp: [wan] IPADDR 81.146.178.2
May 27 01:23:35 ppp: [wan] IPCP: rec'd Configure Request #183 (Req-Sent)
May 27 01:23:35 ppp: [wan] COMPPROTO VJCOMP, 16 comp. channels, no comp-cid
May 27 01:23:35 ppp: [wan] IPADDR 0.0.0.0
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: esh on May 27, 2011, 10:26:00
Looks like a total mess. Here is some excerpts.


May 27 02:23:10 mpd: AUTHPROTO CHAP MD5
May 27 02:23:10 mpd: Using authname
May 27 02:23:29 last message repeated 7 times
May 27 02:23:36 mpd: Name: "ESR8.Miltonkeynes3"
May 27 02:23:51 mpd: MESG: Authentication failure
May 27 02:23:59 mpd: MESG: Authentication failure
...
May 27 02:27:25 mpd: Name: "ESR8.Miltonkeynes3"
May 27 02:27:25 mpd: Using authname "<<omitted>>@gw5"
May 27 02:29:27 mpd: ENDPOINTDISC [LOCAL] 74 65 6c 65 68 6f 75 73 65 2d 67 77 32
May 27 02:29:27 mpd: Name: "telehouse-gw2"
May 27 02:29:59 mpd: Name: "ESR8.Miltonkeynes3"
May 27 02:29:59 mpd: ENDPOINTDISC [LOCAL] 74 65 6c 65 68 6f 75 73 65 2d 67 77 32
May 27 02:29:59 mpd: MP MRRU 1524
May 27 02:29:59 mpd: Name: "telehouse-gw2"
May 27 02:30:31 mpd: Name: "ESR8.Miltonkeynes3"
May 27 02:31:24 mpd: Name: "telehouse-gw4"
May 27 02:31:47 mpd: COMPPROTO VJCOMP, 16 comp. channels, no comp-cid
May 27 02:31:47 mpd: IPADDR 0.0.0.0
May 27 02:31:59 mpd: Name: "ESR8.Miltonkeynes3"
May 27 02:32:00 mpd: ENDPOINTDISC [LOCAL] 74 65 6c 65 68 6f 75 73 65 2d 67 77 32
May 27 02:32:00 mpd: Name: "telehouse-gw2"
May 27 02:32:28 mpd: Name: "ESR8.Miltonkeynes3"
May 27 02:32:28 mpd: Name: "telehouse-gw4"
May 27 02:32:30 mpd: <<IP>> is OK
May 27 02:32:30 mpd: IPADDR <<IP>>
May 27 02:32:46 check_reload_status: rc.newwanip starting
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Rik on May 27, 2011, 10:30:45
Quote from: jameshurrell on May 27, 2011, 10:15:42
Hi Rik, two lines are 20CN and one is 21CN. All had the outage.

Thanks, James, that eliminates one variable. :)
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Rik on May 27, 2011, 10:37:45
I understand that a brief 'blip' caused connections to fail over to a second radius server, this became briefly over-loaded, leading to the inability to connect for a short period. That cleared itself and most people had re-connected within 15 minutes or so. There may be one or two who have stale sessions which a router re-boot should clear.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Steve on May 27, 2011, 10:53:57
 Mine never reconnected without a reboot,although it was repeatedly trying for 4 hours.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Rik on May 27, 2011, 10:57:58
Mine was fine, I wouldn't have known anything had happened if it wasn't for this thread. :)
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: esh on May 27, 2011, 10:58:22
Are these radius servers under BT's authority?
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Rik on May 27, 2011, 10:59:29
I'm not sure, tbh. There definitely are BT radius servers, but whether they're reciprocated on the IDNet side I don't know.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Steve on May 27, 2011, 11:01:15
I know that there was an issue with the MK BRAS yesterday but that was at midday.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Rik on May 27, 2011, 11:02:04
There's 11 MUXes down in Yorkshire this morning due to a cable fault.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Steve on May 27, 2011, 11:04:18
Or missing cable  :whistle:
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Rik on May 27, 2011, 11:05:11
 ;D

Shame if they thought they were getting copper and ended up with fibre.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: esh on May 27, 2011, 12:19:44
BT seem to have been up to an abnormally high amount of maintenance lately (anti-maintenance? unmaintenance?)
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Rik on May 27, 2011, 12:20:33
Trouble making? ;D
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: DorsetBoy on May 27, 2011, 12:27:18
Quote from: esh on May 27, 2011, 12:19:44
BT seem to have been up to an abnormally high amount of maintenance lately (anti-maintenance? unmaintenance?)

They are trying Quantisation  on 20CN apparently .
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Rik on May 27, 2011, 12:28:17
They'll try anything except spending money. ;)
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: DorsetBoy on May 27, 2011, 12:33:22
Quote from: Rik on May 27, 2011, 12:28:17
They'll try anything except spending money. ;)

I'm glad that I don't have any of this going on any more, LLU is soooooo much better  :evil:
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Rik on May 27, 2011, 12:38:35
 ;D

Unless it's with Talk Talk.  :whistle:
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: DorsetBoy on May 27, 2011, 12:41:09
Quote from: Rik on May 27, 2011, 12:38:35
;D

Unless it's with Talk Talk.  :whistle:

;D ;D I think their customers are OK till something goes wrong, that's when they regret changing over. Thankfully I have someone else to ear bend should the need arise.

Just noticed that it is 11 months today on LLU without a single ISP/supplier fault, the one issue was a fibre break due to a lorry taking out lines in an accident.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: cavillas on May 27, 2011, 12:43:08
ANything to do with This (http://btbusiness.custhelp.com/app/service_status_consumer/ss_cat/2468,2470)  Some problems going on.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Rik on May 27, 2011, 12:44:38
Not as far as I know, Alf, this was a specific BT-to-IDNet problem.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: esh on May 27, 2011, 18:44:46
I had to endure Opal/TalkTalk for a year somewhere, that was pretty bad. I think it averaged about 1-3 hours of downtime per week, with every other month having a 6 hours+ fault.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Rik on May 27, 2011, 18:45:11
Ouch. :(
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: pctech on May 27, 2011, 19:13:57
Quote from: Rik on May 27, 2011, 10:59:29
I'm not sure, tbh. There definitely are BT radius servers, but whether they're reciprocated on the IDNet side I don't know.

I think the BT Radius servers check the bit after @ in the username (the realm) and direct the traffic toward the relevant ISP's hostlink provided of course that ISP has a contract with BT for that particular user's xDSL circuit.

That is my understanding anyway.

Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: .Griff. on May 27, 2011, 19:15:47
Only just spotted this.

Same thing happened on my FTTC connection. I just assumed it was me!  ;D
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: joe on May 28, 2011, 08:00:20

I wasn't aware of it but checking back now I appear to have suffered similar for three nights 25-27 May (Brentwood Exchange):-

25th: <a title="Broadband Ping" href="http://www.thinkbroadband.com/ping/share/c0fe872dbdf14b62011a51948ba69ed4-25-05-2011.html"><img alt="My Broadband Ping - bj" src="http://www.thinkbroadband.com/ping/share-thumb/c0fe872dbdf14b62011a51948ba69ed4-25-05-2011.png" /></a>

26th: <a title="Broadband Ping" href="http://www.thinkbroadband.com/ping/share/dd9b8d33540ab5adf820f257b07b777b-26-05-2011.html"><img alt="My Broadband Ping - bj" src="http://www.thinkbroadband.com/ping/share-thumb/dd9b8d33540ab5adf820f257b07b777b-26-05-2011.png" /></a>

27th: <a title="Broadband Ping" href="http://www.thinkbroadband.com/ping/share/2445a798da7ed174ad593c2081f10b39-27-05-2011.html"><img alt="My Broadband Ping - bj" src="http://www.thinkbroadband.com/ping/share-thumb/2445a798da7ed174ad593c2081f10b39-27-05-2011.png" /></a>

Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: DorsetBoy on May 28, 2011, 08:13:59
You can't post HTML links in the forum, you need to choose the "forum" code from the list at TB.


This is what you want.

27th: [url=http://www.thinkbroadband.com/ping/share/2445a798da7ed174ad593c2081f10b39-27-05-2011.html][img]http://www.thinkbroadband.com/ping/share-thumb/2445a798da7ed174ad593c2081f10b39-27-05-2011.png[/img][/url]


25th:

(http://www.thinkbroadband.com/ping/share-thumb/c0fe872dbdf14b62011a51948ba69ed4-25-05-2011.png) (http://www.thinkbroadband.com/ping/share/c0fe872dbdf14b62011a51948ba69ed4-25-05-2011.html)


26th:

(http://www.thinkbroadband.com/ping/share-thumb/dd9b8d33540ab5adf820f257b07b777b-26-05-2011.png) (http://www.thinkbroadband.com/ping/share/dd9b8d33540ab5adf820f257b07b777b-26-05-2011.html)


27th:

(http://www.thinkbroadband.com/ping/share-thumb/2445a798da7ed174ad593c2081f10b39-27-05-2011.png) (http://www.thinkbroadband.com/ping/share/2445a798da7ed174ad593c2081f10b39-27-05-2011.html)
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: Technical Ben on May 28, 2011, 09:27:58
Are those disconnects from you setting the router up? Or is it a sign someone trying to communicate in morse code Dorset?  :eyebrow:
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: joe on May 28, 2011, 09:43:29
Thanks for the advice and corrrection of my links DorsetBoy. TB has changed its links since the last time I up/ld a chart.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: DorsetBoy on May 28, 2011, 10:56:36
Quote from: Technical Ben on May 28, 2011, 09:27:58
Are those disconnects from you setting the router up? Or is it a sign someone trying to communicate in morse code Dorset?  :eyebrow:

What are disconnects  ;D  ....... they aren't mine Ben, I just corrected the links Joe posted earlier.
Title: Re: Short Outage - Early Friday morning - Anyone else?
Post by: JB on May 29, 2011, 09:34:57
Having started this thread, I apologise for not having contributed again. Family matters got in the way.

I finally found that my router was going faulty, in that after being on for many hours, it seemed to lose internet connectivity. The link to the DSLAM in the local exchange was OK but the internet layer above that seemed to be failing. It was only a cheap standby router and it is now packaged up for return to Amazon.

Like many people in the similar thread, I experienced the drop out at 3am in the morning a day or two ago, and yesterday afternoon like others, experienced what seems to have been some form of DNS error, lasting about 10 minutes.

Thanks to everyone for replying.