[IPv6crawler-wg] Routing problems resolved on IPv6 Day

Olivier MJ Crepin-Leblond ocl at gih.com
Thu Jun 9 17:57:52 BST 2011


Hello All,

one good thing about IPv6 day is that if there was any kind of routing
problem, because everybody was watching, those were resolved fast.

For example, have a look at this thread, which I have pasted back
together - taking the www.ipv6matrix.org upstream routing transient
problem issue which appeared from time to time.

Throughout the day, the IPv6-ops list was kept very busy. I never told
anyone on the list about the occasional problem, but since we had a lot
of exposure yesterday, someone picked this up quite spontaneously.

Please see the chronology of things below (whilst of course keeping in
mind that the chaps at 2020Media, our hosting provider, were also
enquiring directly with their upstream about what was going on)

If there was one take-away for this IPv6 day, it's that a lot of small
problems like this were fixed in a matter of hours, and that was really
great!
:-)

Kind regards,

Olivier

--- start here ---


-------- Message original --------
Sujet: 	Re: Test your connectivity for World IPv6 Day
Date : 	Wed, 08 Jun 2011 08:14:45 +0300
De : 	Tassos Chatzithomaoglou <achatz at forthnet.gr>
Pour : 	IPv6-OPS <ipv6-ops at lists.cluenet.de>



Seeing some ping-pong issues with www.ipv6matrix.org on NewNet.

>tracert www.ipv6matrix.org

Tracing route to elephant.ipv6matrix.org [2a00:19e8:20:1::aa]
over a maximum of 30 hops:

  1 <1 ms <1 ms <1 ms  2a02:2148:100:902::1
  2   163 ms    64 ms    33 ms  2a02:2148:77:77:2::6
  3    94 ms    34 ms    34 ms  2a02:2148:2:2000::1
  4    88 ms   170 ms    90 ms  20gigabitethernet4-3.core1.fra1.he.net 
[2001:7f8::1b1b:0:1]
  5   140 ms    97 ms    97 ms  10gigabitethernet5-3.core1.lon1.he.net 
[2001:470:0:1d2::1]
  6    99 ms   159 ms    98 ms  2001:7f8:4::23e7:1
  7    99 ms   115 ms   201 ms  2a01:178:9191:3::200
  8   115 ms    98 ms    97 ms  2a01:178:9191:3::1
  9    98 ms    98 ms    98 ms  2a01:178:9191:3::200
 10   102 ms    97 ms    98 ms  2a01:178:9191:3::1
 11   122 ms    97 ms   192 ms  2a01:178:9191:3::200
 12    98 ms   132 ms    98 ms  2a01:178:9191:3::1
 13    99 ms    97 ms    97 ms  2a01:178:9191:3::200
 14   195 ms    98 ms    98 ms  2a01:178:9191:3::1
 15    98 ms    97 ms    98 ms  2a01:178:9191:3::200
 16    97 ms    98 ms    98 ms  2a01:178:9191:3::1
 17    99 ms    98 ms    99 ms  2a01:178:9191:3::200
 18   129 ms    98 ms    98 ms  2a01:178:9191:3::1
 19    99 ms    98 ms    99 ms  2a01:178:9191:3::200
 20    98 ms   109 ms    99 ms  2a01:178:9191:3::1
 21    99 ms    97 ms    98 ms  2a01:178:9191:3::200
 22    98 ms   139 ms    98 ms  2a01:178:9191:3::1
 23    99 ms    99 ms    99 ms  2a01:178:9191:3::200
 24    99 ms    99 ms    99 ms  2a01:178:9191:3::1
 25    99 ms    98 ms   155 ms  2a01:178:9191:3::200
 26   100 ms    99 ms    99 ms  2a01:178:9191:3::1
 27   100 ms   123 ms    99 ms  2a01:178:9191:3::200
 28    99 ms    98 ms   132 ms  2a01:178:9191:3::1
 29    99 ms    99 ms    99 ms  2a01:178:9191:3::200
 30   102 ms   222 ms   213 ms  2a01:178:9191:3::1

Trace complete.

--
Tassos





-------- Message original --------
Sujet: 	RE: Test your connectivity for World IPv6 Day
Date : 	Wed, 8 Jun 2011 00:22:12 -0500
De : 	Frank Bulk <frnkblk at iname.com>
Répondre à : 	frnkblk at iname.com
Pour : 	'Tassos Chatzithomaoglou' <achatz at forthnet.gr>, IPv6-OPS
<ipv6-ops at lists.cluenet.de>



Perhaps not anymore?

nagios:/tmp#  traceroute6 www.ipv6matrix.org
traceroute to www.ipv6matrix.org (2a00:19e8:20:1::aa), 30 hops max, 80 byte
packets
 1  2607:fe28:0:1003::2 (2607:fe28:0:1003::2)  3.923 ms  4.353 ms  5.383 ms
 2  router-core.mtcnet.net (2607:fe28:0:1000::1)  6.074 ms  6.372 ms  6.713
ms
 3  sxct.movl.mtcnet.net (2607:fe28:11:1002::194)  8.271 ms  8.516 ms  9.341
ms
 4  v6-siouxcenter.movl.153.netins.net (2001:5f8:7f06::9)  16.877 ms  17.124
ms  17.332 ms
 5  v6-ins-kb1-et-11-6-307.kmrr.netins.net (2001:5f8:2:2::1)  20.513 ms
20.781 ms  21.116 ms
 6  v6-ins-kc1-te-9-2.kmrr.netins.net (2001:5f8::10:1)  21.508 ms  17.599 ms
17.863 ms
 7  sl-crs4-chi-te0-2-0-1.v6.sprintlink.net (2600:4::6)  26.898 ms  26.054
ms  26.249 ms
 8  sl-crs3-chi-po0-1-2-0.v6.sprintlink.net (2600:0:2:1239:144:232:3:143)
27.093 ms  26.052 ms  26.103 ms
 9  sl-st30-chi-po0-4-0-0.v6.sprintlink.net (2600:0:2:1239:144:232:8:184)
26.206 ms  20.901 ms  23.879 ms
10  * * *
11  10gigabitethernet7-2.core1.nyc4.he.net (2001:470:0:1c6::1)  63.056 ms
64.132 ms  63.923 ms
12  10gigabitethernet3-3.core1.lon1.he.net (2001:470:0:128::2)  131.639 ms
131.642 ms  132.250 ms
13  * * *
14  2a01:178:9191:3::17 (2a01:178:9191:3::17)  133.774 ms  134.849 ms
134.514 ms
15  2a01:178:500::6 (2a01:178:500::6)  128.390 ms  128.413 ms  128.602 ms
16  2a00:19e8::1:d (2a00:19e8::1:d)  128.893 ms  127.646 ms  127.683 ms
17  2a00:19e8::1:5 (2a00:19e8::1:5)  127.557 ms  126.850 ms *
18  elephant.ipv6matrix.org (2a00:19e8:20:1::aa)  128.325 ms  127.747 ms
127.941 ms
nagios:/tmp#





-------- Message original --------

Sujet: 	Re: Test your connectivity for World IPv6 Day
Date : 	Wed, 08 Jun 2011 08:57:56 +0300
De : 	Tassos Chatzithomaoglou <achatz at forthnet.gr>
Pour : 	IPv6-OPS <ipv6-ops at lists.cluenet.de>



ping-pong is still on...

Judging from your output, hop 13 must be LINX (hop 6 in my output).
Then going through 2a01:178:9191:3::17 in your output vs
2a01:178:9191:3::200 in my output.

Trying a trace on LINX LG (226.x peers), it returns your path.
Trying a trace on LINX LG (224.x peers), it returns my path (or "Command
timed out").

Looking Glass Query results

Type escape sequence to abort.
Tracing the route to elephant.ipv6matrix.org (2A00:19E8:20:1::AA)

1 2001:7F8:4::23E7:1 4 msec 0 msec 0 msec
2 2A01:178:9191:3::200 4 msec 0 msec 0 msec
3 2A01:178:9191:3::1 0 msec 4 msec 0 msec
4 2A01:178:9191:3::200 0 msec 0 msec 0 msec
5 2A01:178:9191:3::1 8 msec 4 msec 4 msec
6 2A01:178:9191:3::200 0 msec 0 msec 0 msec
7 2A01:178:9191:3::1 4 msec 4 msec 0 msec
8 2A01:178:9191:3::200 0 msec 0 msec 0 msec
9 2A01:178:9191:3::1 0 msec 4 msec *
10 2A01:178:9191:3::200 0 msec 4 msec 0 msec
11 2A01:178:9191:3::1 0 msec 4 msec 0 msec
12 2A01:178:9191:3::200 0 msec 0 msec 0 msec
13 2A01:178:9191:3::1 4 msec 0 msec 0 msec
14 2A01:178:9191:3::200 4 msec 0 msec 4 msec
15 2A01:178:9191:3::1 0 msec 4 msec *
16 2A01:178:9191:3::200 0 msec 0 msec 0 msec
17 2A01:178:9191:3::1 4 msec 0 msec 0 msec
18 2A01:178:9191:3::200 4 msec 4 msec 4 msec
19 2A01:178:9191:3::1 0 msec 20 msec 0 msec
20 2A01:178:9191:3::200 0 msec 0 msec 4 msec
21 *
2A01:178:9191:3::1 0 msec 4 msec
22 2A01:178:9191:3::200 4 msec 0 msec 4 msec
23 2A01:178:9191:3::1 8 msec 4 msec 4 msec
24 2A01:178:9191:3::200 4 msec 4 msec 4 msec
25 2A01:178:9191:3::1 8 msec 4 msec 4 msec
26 2A01:178:9191:3::200 4 msec 0 msec 8 msec
27 2A01:178:9191:3::1 0 msec * 4 msec
28 2A01:178:9191:3::200 4 msec 0 msec 0 msec
29 2A01:178:9191:3::1 0 msec 4 msec 4 msec
30 2A01:178:9191:3::200 4 msec 0 msec 0 msec
Destination not found inside max hopcount diameter.


--
Tassos



-------- Message original --------
Sujet:     Re: Test your connectivity for World IPv6 Day
Date :     Wed, 08 Jun 2011 09:19:11 +0300
De :     Valeriu Vraciu <vvraciu at iasi.roedu.net>
Organisation :     RoEduNet
Pour :     Tassos Chatzithomaoglou <achatz at forthnet.gr>
Copie à :     IPv6-OPS <ipv6-ops at lists.cluenet.de>



Hi,

Traceroute6 from AS2614 looks like this:

bwt:~/tmp/# date
Wed Jun  8 09:13:34 EEST 2011
bwt:~/tmp/# traceroute6 www.ipv6matrix.org
traceroute to www.ipv6matrix.org (2a00:19e8:20:1::aa), 30 hops max, 40
byte packets
 1  2001:b30:1::1 (2001:b30:1::1)  0.549 ms  0.604 ms  0.710 ms
 2  2001:b30:0:5::1 (2001:b30:0:5::1)  0.379 ms  0.506 ms  0.579 ms
 3  te-4-3.br1.nat.roedu.net (2001:b30:0:b::1)  1.760 ms * *
 4  buca-b1-link.telia.net (2001:2000:3080:14b::1)  0.412 ms  0.484 ms
0.470 ms
 5  s-fre-i28-v6.telia.net (2001:2000:3018:29::1)  58.488 ms  58.571 ms
 58.695 ms
 6  s-fre-i28-v6.telia.net (2001:2000:3018:29::1)  58.778 ms  58.697 ms
 58.074 ms
 7  2001:2000:3080::2 (2001:2000:3080::2)  82.394 ms * *
 8  ten1-0-0.t40-cr1.ipv6.router.uk.clara.net (2001:a88:0:1::119)
82.530 ms * *
 9  g4-1-t40-br2.ipv6.router.uk.clara.net (2001:a88:0:1::d9)  82.557 ms
 82.495 ms  106.984 ms
10  2001:a88:0:2::3a (2001:a88:0:2::3a)  83.676 ms  83.729 ms  83.778 ms
11  elephant.ipv6matrix.org (2a00:19e8:20:1::aa)  83.080 ms  83.079 ms
83.031 ms




-------- Message original --------
Sujet: 	RE: Test your connectivity for World IPv6 Day
Date : 	Wed, 8 Jun 2011 09:20:50 +0200
De : 	Johan REMY <ipv6-ops-cluenet at remy-fr.eu>
Pour : 	IPv6-OPS <ipv6-ops at lists.cluenet.de>



>From the same computer but two different IPv6, I get different result
(as16347 for both). One is working and the other is looping between
"2a01:178:9191:3::200" and "2a01:178:9191:3::1"

Maybe there is loadbalancing based and source IPv6 and one the router
doesn't know the right route ?

The first one :
 10    14 ms    23 ms    24 ms  10gigabitethernet1-3.core1.lon1.he.net
[2001:470:0:42::1]
 11    14 ms    14 ms    14 ms  2001:7f8:4::23e7:1
 12    13 ms    14 ms    13 ms  2a01:178:9191:3::200
 13    14 ms    14 ms    14 ms  2a01:178:9191:3::1
 14    14 ms    13 ms    13 ms  2a01:178:9191:3::200
 15    15 ms    14 ms    14 ms  2a01:178:9191:3::1
 16    14 ms    14 ms    14 ms  2a01:178:9191:3::200
Etc...


The other one (same computer, same /64 but different IPv6) : 
10:  2001:470:0:42::1                                     12.006ms asymm  9 
11:  2001:7f8:4::23e7:1                                   20.010ms asymm 10 
12:  2a01:178:9191:3::200                                 16.008ms asymm 11 
13:  2a01:178:9191:3::1                                   16.008ms asymm 10 
14:  2a01:178:9191:3::17                                  16.008ms asymm 11 
15:  2a01:178:500::6                                      16.008ms asymm 12 
16:  2a00:19e8::1:d                                       20.010ms asymm 13 
17:  2a00:19e8::1:5                                       20.010ms asymm 13 
18:  2a00:19e8:20:1::aa                                   20.010ms reached


Johan REMY





-------- Message original --------
Sujet: 	Re: Test your connectivity for World IPv6 Day
Date : 	Wed, 08 Jun 2011 10:42:51 +0200 (CEST)
De : 	sthaug at nethelp.no
Pour : 	frnkblk at iname.com
Copie à : 	ipv6-ops at lists.cluenet.de, achatz at forthnet.gr



> Perhaps not anymore?
> 
> nagios:/tmp#  traceroute6 www.ipv6matrix.org
> traceroute to www.ipv6matrix.org (2a00:19e8:20:1::aa), 30 hops max, 80 byte
> packets
>  1  2607:fe28:0:1003::2 (2607:fe28:0:1003::2)  3.923 ms  4.353 ms  5.383 ms
>  2  router-core.mtcnet.net (2607:fe28:0:1000::1)  6.074 ms  6.372 ms  6.713
> ms
>  3  sxct.movl.mtcnet.net (2607:fe28:11:1002::194)  8.271 ms  8.516 ms  9.341
> ms
>  4  v6-siouxcenter.movl.153.netins.net (2001:5f8:7f06::9)  16.877 ms  17.124
> ms  17.332 ms
>  5  v6-ins-kb1-et-11-6-307.kmrr.netins.net (2001:5f8:2:2::1)  20.513 ms
> 20.781 ms  21.116 ms
>  6  v6-ins-kc1-te-9-2.kmrr.netins.net (2001:5f8::10:1)  21.508 ms  17.599 ms
> 17.863 ms
>  7  sl-crs4-chi-te0-2-0-1.v6.sprintlink.net (2600:4::6)  26.898 ms  26.054
> ms  26.249 ms
>  8  sl-crs3-chi-po0-1-2-0.v6.sprintlink.net (2600:0:2:1239:144:232:3:143)
> 27.093 ms  26.052 ms  26.103 ms
>  9  sl-st30-chi-po0-4-0-0.v6.sprintlink.net (2600:0:2:1239:144:232:8:184)
> 26.206 ms  20.901 ms  23.879 ms
> 10  * * *
> 11  10gigabitethernet7-2.core1.nyc4.he.net (2001:470:0:1c6::1)  63.056 ms
> 64.132 ms  63.923 ms
> 12  10gigabitethernet3-3.core1.lon1.he.net (2001:470:0:128::2)  131.639 ms
> 131.642 ms  132.250 ms
> 13  * * *
> 14  2a01:178:9191:3::17 (2a01:178:9191:3::17)  133.774 ms  134.849 ms
> 134.514 ms
> 15  2a01:178:500::6 (2a01:178:500::6)  128.390 ms  128.413 ms  128.602 ms
> 16  2a00:19e8::1:d (2a00:19e8::1:d)  128.893 ms  127.646 ms  127.683 ms
> 17  2a00:19e8::1:5 (2a00:19e8::1:5)  127.557 ms  126.850 ms *
> 18  elephant.ipv6matrix.org (2a00:19e8:20:1::aa)  128.325 ms  127.747 ms
> 127.941 ms
> nagios:/tmp#

I reached it earlier today - now I'm getting a loop again:

% traceroute6 www.ipv6matrix.org
traceroute6 to elephant.ipv6matrix.org (2a00:19e8:20:1::aa) from 2001:8c0:9602:1::2, 64 hops max, 12 byte packets
 1  ge0-0-0-10.ar1.skxy.no.catchbone.net  8.520 ms  9.092 ms  10.041 ms
 2  ge0-0-2.cr2.osls.no.catchbone.net  10.360 ms  8.603 ms  10.351 ms
 3  te2-3-0.br2.mejv.se.catchbone.net  16.740 ms  14.078 ms  15.490 ms
 4  10gigabitethernet1-3.core1.sto1.he.net  15.663 ms  21.437 ms  24.854 ms
 5  10gigabitethernet3-3.core1.fra1.he.net  42.632 ms  49.032 ms  50.749 ms
 6  10gigabitethernet5-3.core1.lon1.he.net  51.215 ms  53.237 ms  50.208 ms
 7  2001:7f8:4::23e7:1  54.859 ms  54.911 ms  55.031 ms
 8  2a01:178:9191:3::200  54.223 ms  56.567 ms  53.365 ms
 9  2a01:178:9191:3::1  54.974 ms  54.340 ms  54.929 ms
10  2a01:178:9191:3::200  54.552 ms  54.361 ms  55.203 ms
11  2a01:178:9191:3::1  57.085 ms  52.958 ms  55.140 ms
<repeat ad nauseam>

Steinar Haug, Nethelp consulting, sthaug at nethelp.no




-------- Message original --------
Sujet: 	Re: Test your connectivity for World IPv6 Day
Date : 	Wed, 8 Jun 2011 11:38:50 +0200
De : 	Ignatios Souvatzis <ignatios at cs.uni-bonn.de>
Pour : 	sthaug at nethelp.no
Copie à : 	achatz at forthnet.gr, ipv6-ops at lists.cluenet.de, frnkblk at iname.com



Works from both "here"s at the moment. 

Work (DFN) -> clara.net -> 2001:a88:0:2::3a -> elephant
Home (RH-TEC) -> 2a00:19ea::1:d -> elephant

	-is




-------- Message original --------
Sujet: 	Re: Test your connectivity for World IPv6 Day
Date : 	Wed, 08 Jun 2011 14:43:38 +0100
De : 	ben <ben at slopez.co.uk>
Pour : 	ipv6-ops at lists.cluenet.de



>/ Perhaps not anymore?
/>/ 
/>/ nagios:/tmp#  traceroute6 www.ipv6matrix.org
/>/ traceroute to www.ipv6matrix.org (2a00:19e8:20:1::aa), 30 hops max, 80 byte
/>/ packets
/>/  1  2607:fe28:0:1003::2 (2607:fe28:0:1003::2)  3.923 ms  4.353 ms  5.383 ms
/>/  2  router-core.mtcnet.net (2607:fe28:0:1000::1)  6.074 ms  6.372 ms  6.713
/>/ ms
/>/  3  sxct.movl.mtcnet.net (2607:fe28:11:1002::194)  8.271 ms  8.516 ms  9.341
/>/ ms
/>/  4  v6-siouxcenter.movl.153.netins.net (2001:5f8:7f06::9)  16.877 ms  17.124
/>/ ms  17.332 ms
/>/  5  v6-ins-kb1-et-11-6-307.kmrr.netins.net (2001:5f8:2:2::1)  20.513 ms
/>/ 20.781 ms  21.116 ms
/>/  6  v6-ins-kc1-te-9-2.kmrr.netins.net (2001:5f8::10:1)  21.508 ms  17.599 ms
/>/ 17.863 ms
/>/  7  sl-crs4-chi-te0-2-0-1.v6.sprintlink.net (2600:4::6)  26.898 ms  26.054
/>/ ms  26.249 ms
/>/  8  sl-crs3-chi-po0-1-2-0.v6.sprintlink.net (2600:0:2:1239:144:232:3:143)
/>/ 27.093 ms  26.052 ms  26.103 ms
/>/  9  sl-st30-chi-po0-4-0-0.v6.sprintlink.net (2600:0:2:1239:144:232:8:184)
/>/ 26.206 ms  20.901 ms  23.879 ms
/>/ 10  * * *
/>/ 11  10gigabitethernet7-2.core1.nyc4.he.net (2001:470:0:1c6::1)  63.056 ms
/>/ 64.132 ms  63.923 ms
/>/ 12  10gigabitethernet3-3.core1.lon1.he.net (2001:470:0:128::2)  131.639 ms
/>/ 131.642 ms  132.250 ms
/>/ 13  * * *
/>/ 14  2a01:178:9191:3::17 (2a01:178:9191:3::17)  133.774 ms  134.849 ms
/>/ 134.514 ms
/>/ 15  2a01:178:500::6 (2a01:178:500::6)  128.390 ms  128.413 ms  128.602 ms
/>/ 16  2a00:19e8::1:d (2a00:19e8::1:d)  128.893 ms  127.646 ms  127.683 ms
/>/ 17  2a00:19e8::1:5 (2a00:19e8::1:5)  127.557 ms  126.850 ms *
/>/ 18  elephant.ipv6matrix.org (2a00:19e8:20:1::aa)  128.325 ms  127.747 ms
/>/ 127.941 ms
/>/ nagios:/tmp#
/>
> I reached it earlier today - now I'm getting a loop again:
> 
> % traceroute6 www.ipv6matrix.org
> traceroute6 to elephant.ipv6matrix.org (2a00:19e8:20:1::aa) from 2001:8c0:9602:1::2, 64 hops max, 12 byte packets
>  1  ge0-0-0-10.ar1.skxy.no.catchbone.net  8.520 ms  9.092 ms  10.041 ms
>  2  ge0-0-2.cr2.osls.no.catchbone.net  10.360 ms  8.603 ms  10.351 ms
>  3  te2-3-0.br2.mejv.se.catchbone.net  16.740 ms  14.078 ms  15.490 ms
>  4  10gigabitethernet1-3.core1.sto1.he.net  15.663 ms  21.437 ms  24.854 ms
>  5  10gigabitethernet3-3.core1.fra1.he.net  42.632 ms  49.032 ms  50.749 ms
>  6  10gigabitethernet5-3.core1.lon1.he.net  51.215 ms  53.237 ms  50.208 ms
>  7  2001:7f8:4::23e7:1  54.859 ms  54.911 ms  55.031 ms
>  8  2a01:178:9191:3::200  54.223 ms  56.567 ms  53.365 ms
>  9  2a01:178:9191:3::1  54.974 ms  54.340 ms  54.929 ms
> 10  2a01:178:9191:3::200  54.552 ms  54.361 ms  55.203 ms
> 11  2a01:178:9191:3::1  57.085 ms  52.958 ms  55.140 ms
> <repeat ad nauseam>

OK fixed

ben wilkinson
newnet plc


--- cut here -- end of thread ---

A Hollywood Happy End. :-)

-- 
Olivier MJ Crépin-Leblond, PhD
http://www.gih.com/ocl.html

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://salsa.gih.co.uk/pipermail/ipv6crawler-wg/attachments/20110609/598a8996/attachment-0001.html>


More information about the IPv6crawler-wg mailing list