<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=windows-1252">
</head>
<body bgcolor="#FFFFFF" text="#000000">
FYI -- both servers have rebooted perfectly well after their first
48H beak in 590 days!<br>
<br>
reboot system boot 2.6.18-406.el5PA Thu Mar 31 07:50
(07:11)<br>
reboot system boot 2.6.18-371.9.1.e Sun Aug 17 10:12
(590+05:43)<br>
<br>
<div class="moz-forward-container">Kindest regards,<br>
<br>
Olivier<br>
<br>
-------- Forwarded Message --------
<table class="moz-email-headers-table" border="0" cellpadding="0"
cellspacing="0">
<tbody>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">Subject:
</th>
<td>Re: Power Outage affecting you servers - 29th-31st March</td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">Date: </th>
<td>Thu, 31 Mar 2016 16:13:41 +0200</td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">From: </th>
<td>Olivier MJ Crepin-Leblond <a class="moz-txt-link-rfc2396E" href="mailto:ocl@gih.com"><ocl@gih.com></a></td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">To: </th>
<td>Metcalf C. (iSolutions) <a class="moz-txt-link-rfc2396E" href="mailto:C.Metcalf@soton.ac.uk"><C.Metcalf@soton.ac.uk></a>,
Tim Chown <a class="moz-txt-link-rfc2396E" href="mailto:tjc@ecs.soton.ac.uk"><tjc@ecs.soton.ac.uk></a>, Lance Draper
<a class="moz-txt-link-rfc2396E" href="mailto:ld@ecs.soton.ac.uk"><ld@ecs.soton.ac.uk></a></td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">CC: </th>
<td>Newman David <a class="moz-txt-link-rfc2396E" href="mailto:drn@ecs.soton.ac.uk"><drn@ecs.soton.ac.uk></a>, Webb J.P.
<a class="moz-txt-link-rfc2396E" href="mailto:j.p.webb@soton.ac.uk"><j.p.webb@soton.ac.uk></a>, Olivier MJ Crepin-Leblond
<a class="moz-txt-link-rfc2396E" href="mailto:ocl@gih.com"><ocl@gih.com></a></td>
</tr>
</tbody>
</table>
<br>
<br>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
Dear Chrissie,<br>
<br>
thank you for your kind note. I have given the two machines a full
health check and it looks like they've rebooted well and are
operating normally.<br>
<br>
I do however note one small glitch: it looks like there might be a
firewall issue between login.ecs.soton.ac.uk and
crawler.ipv6matrix.org: I cannot seem to be able to SSH directly
from login.ecs.soton.ac.uk to crawler.ipv6matrix.org whilst I can
SSH into <a moz-do-not-send="true"
class="moz-txt-link-abbreviated"
href="http://www.ipv6matrix.org">www.ipv6matrix.org</a> and then
SSH from there to crawler.ipv6matrix.org<br>
<br>
Alternatively, it could be a reverse DNS problem. I have done the
following traceroutes from login.ecs.soton.ac.uk:<br>
<br>
traceroute to crawler.ipv6matrix.org (152.78.189.211), 30 hops
max, 40 byte packets<br>
1 servers-router.core.ecs.soton.ac.uk (152.78.68.190) 0.761 ms
0.802 ms 0.856 ms<br>
2 fw2.core.ecs.soton.ac.uk (152.78.70.228) 0.653 ms 0.766 ms
0.830 ms<br>
3 <a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="http://www.ipv6matrix.org">www.ipv6matrix.org</a>
(152.78.189.211) 1.737 ms !X 1.934 ms !X 1.989 ms !X<br>
-bash-3.2$ traceroute <a moz-do-not-send="true"
class="moz-txt-link-abbreviated"
href="http://www.ipv6matrix.org">www.ipv6matrix.org</a><br>
traceroute to <a moz-do-not-send="true"
class="moz-txt-link-abbreviated"
href="http://www.ipv6matrix.org">www.ipv6matrix.org</a>
(152.78.189.209), 30 hops max, 40 byte packets<br>
1 servers-router.core.ecs.soton.ac.uk (152.78.68.190) 0.758 ms
0.802 ms 0.857 ms<br>
2 fw2.core.ecs.soton.ac.uk (152.78.70.228) 0.654 ms 0.770 ms
0.880 ms<br>
3 elephant.ecs.soton.ac.uk (152.78.189.209) 2.313 ms 2.438 ms
2.494 ms<br>
-bash-3.2$<br>
<br>
Strange how traceroute reverse resolves crawler.ipv6matrix.org as
<a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="http://www.ipv6matrix.org">www.ipv6matrix.org</a> and <a
moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="http://www.ipv6matrix.org"><a class="moz-txt-link-abbreviated" href="http://www.ipv6matrix.org">www.ipv6matrix.org</a></a> as
elephant.ecs.soton.ac.uk<br>
<br>
FYI the correct names should be:<br>
crawler.ipv6matrix.org = turtle.ipv6matrix.org =
turtle.ecs.soton.ac.uk<br>
turtle.ecs.soton.ac.uk has address 152.78.189.211<br>
turtle.ecs.soton.ac.uk has IPv6 address 2001:630:d0:f104::11<br>
<br>
<a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="http://www.ipv6matrix.org">www.ipv6matrix.org</a> =
elephant.ipv6matrix.org = elephant.ecs.soton.ac.uk<br>
elephant.ecs.soton.ac.uk has address 152.78.189.209<br>
elephant.ecs.soton.ac.uk has IPv6 address 2001:630:d0:f104::9<br>
<br>
Kindest regards,<br>
<br>
Olivier<br>
<br>
<div class="moz-cite-prefix">On 31/03/2016 12:14, Metcalf C.
(iSolutions) wrote:<br>
</div>
<blockquote
cite="mid:9713A19FAE8EB74E9E18DCD3BB135A353180EFAF@SRV00048.soton.ac.uk"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:"Consolas",serif;
color:black;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Morning
Olivier<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Both
machines should be back up and running now. <o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Thanks<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Chrissie<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext"
lang="EN-US">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext"
lang="EN-US"> Olivier MJ Crepin-Leblond [<a
moz-do-not-send="true" class="moz-txt-link-freetext"
href="mailto:ocl@gih.com"><a class="moz-txt-link-freetext" href="mailto:ocl@gih.com">mailto:ocl@gih.com</a></a>] <br>
<b>Sent:</b> 29 March 2016 17:13<br>
<b>To:</b> Metcalf C. (iSolutions) <a
moz-do-not-send="true" class="moz-txt-link-rfc2396E"
href="mailto:C.Metcalf@soton.ac.uk"><a class="moz-txt-link-rfc2396E" href="mailto:C.Metcalf@soton.ac.uk"><C.Metcalf@soton.ac.uk></a></a>;
Tim Chown <a moz-do-not-send="true"
class="moz-txt-link-rfc2396E"
href="mailto:tjc@ecs.soton.ac.uk"><tjc@ecs.soton.ac.uk></a>;
Lance Draper <a moz-do-not-send="true"
class="moz-txt-link-rfc2396E"
href="mailto:ld@ecs.soton.ac.uk"><ld@ecs.soton.ac.uk></a><br>
<b>Cc:</b> Newman David <a moz-do-not-send="true"
class="moz-txt-link-rfc2396E"
href="mailto:drn@ecs.soton.ac.uk"><drn@ecs.soton.ac.uk></a>;
Webb J.P. <a moz-do-not-send="true"
class="moz-txt-link-rfc2396E"
href="mailto:J.P.Webb@soton.ac.uk"><J.P.Webb@soton.ac.uk></a><br>
<b>Subject:</b> Re: Power Outage affecting you servers
- 29th-31st March<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">Great to
know that Chrissie. Thanks!<br>
<br>
Olivier<o:p></o:p></p>
<div>
<p class="MsoNormal">On 29/03/2016 18:04, Metcalf C.
(iSolutions) wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Hi
Olivier</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Thank
you for letting us know. We have a member of staff
onsite who will be powering down any remaining machines
before the power is cut to the rooms. </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">We
also have a small team coming to site early on Thursday
morning to begin powering machines back up so they
should be back online first thing. </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Chrissie</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext"
lang="EN-US">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext"
lang="EN-US"> Olivier MJ Crepin-Leblond [<a
moz-do-not-send="true"
class="moz-txt-link-freetext"
href="mailto:ocl@gih.com"><a class="moz-txt-link-freetext" href="mailto:ocl@gih.com">mailto:ocl@gih.com</a></a>]
<br>
<b>Sent:</b> 29 March 2016 16:23<br>
<b>To:</b> Tim Chown <a moz-do-not-send="true"
href="mailto:tjc@ecs.soton.ac.uk"><tjc@ecs.soton.ac.uk></a>;
Lance Draper <a moz-do-not-send="true"
href="mailto:ld@ecs.soton.ac.uk"><ld@ecs.soton.ac.uk></a><br>
<b>Cc:</b> Newman David <a moz-do-not-send="true"
href="mailto:drn@ecs.soton.ac.uk"><drn@ecs.soton.ac.uk></a>;
Webb J.P. <a moz-do-not-send="true"
href="mailto:J.P.Webb@soton.ac.uk"><J.P.Webb@soton.ac.uk></a>;
Metcalf C. (iSolutions) <a moz-do-not-send="true"
href="mailto:C.Metcalf@soton.ac.uk"><C.Metcalf@soton.ac.uk></a>;
Olivier MJ Crepin-Leblond <a moz-do-not-send="true"
href="mailto:ocl@gih.com"><ocl@gih.com></a><br>
<b>Subject:</b> Re: Power Outage affecting you
servers - 29th-31st March</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">Hello,<br>
<br>
confirming that I have shut turtle down completely;
Elephant appears to be unwilling to shut itself down
completely as it is still pinging back but I take it that
it can be powered off safely.<br>
How will you bring the machines back online? Will someone
press the switch?<br>
<br>
Kindest regards,<br>
<br>
Olivier<o:p></o:p></p>
<div>
<p class="MsoNormal">On 21/03/2016 22:46, Olivier MJ
Crepin-Leblond wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal" style="margin-bottom:12.0pt">Hello
all,<br>
<br>
thanks for the advance notice. I'll shut them down on
the day, hours before the deadline & will email you
all when this is done. (hoping they come alive later -
their last reboot, as of today, was 580 days ago!)<br>
Kindest regards,<br>
<br>
Olivier<o:p></o:p></p>
<div>
<p class="MsoNormal">On 21/03/2016 22:25, Tim Chown
wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal">Hi Lance, <o:p></o:p></p>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">In practice, these two systems
are run by Olivier, copied, as an ISOC England
project.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Olivier, we really should press
on towards virtualising these! <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">Tim<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<blockquote
style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">On 21 Mar 2016, at 16:13,
Lance Draper <<a moz-do-not-send="true"
href="mailto:ld@ecs.soton.ac.uk">ld@ecs.soton.ac.uk</a>>
wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">Hi
Tim,</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">There
will be a major power outage affecting
Building 53 on March 30th.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">In
order to prepare iSolutions will shutting
down all server equipment in Building 53
from 16:00 on the 29th.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">Servers
will be powered back on again from 7AM on
the 31st.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">This
will affect your machines called, elephant
and turtle.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">To
minimise the chances of damage to the
machines please can you remotely shut them
down before 16:00 on Tuesday March 29th.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">Apologies
for the inconvenience,</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">Lance</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">Lance
Draper</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">Research
Systems Manager</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">Faculty
of Physical Sciences and Engineering.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif">University
of Southampton</span><o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</blockquote>
<p class="MsoNormal"> <o:p></o:p></p>
</blockquote>
<p class="MsoNormal"> <o:p></o:p></p>
</blockquote>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<pre>-- <o:p></o:p></pre>
<pre>Olivier MJ Crépin-Leblond, PhD<o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="http://www.gih.com/ocl.html">http://www.gih.com/ocl.html</a><o:p></o:p></pre>
</div>
</blockquote>
<br>
<pre class="moz-signature" cols="72">--
Olivier MJ Crépin-Leblond, PhD
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://www.gih.com/ocl.html">http://www.gih.com/ocl.html</a>
</pre>
<br>
</div>
<br>
</body>
</html>