Brief project down-time TODAY

Hi,

Due to an urgent security update we need to shut down the project today. The down-time shouldn't last longer than an hour so you shouldn't notice any significant impact on your crunching efforts. We're going to start as soon as we're ready and we'll post here when we're done.

Thanks,
Oliver 

Comments

Oliver Behnke
Oliver Behnke
Moderator
Administrator
Joined: 4 Sep 07
Posts: 942
Credit: 25166626
RAC: 0

Ok, 16 servers updated and

Ok, 16 servers updated and rebooted. The project is fully up and running again.

Thanks for your patience,
Oliver 

 

Einstein@Home Project

cliff
cliff
Joined: 15 Feb 12
Posts: 176
Credit: 283452444
RAC: 0

There may be a problem, cant

There may be a problem, cant upload results for some reason:-/

21/10/2016 15:35:15 | Einstein@Home | Temporarily failed upload of p2030.20141201.G193.69-00.79.C.b0s0g0.00000_2448_0_0: transient HTTP error

Followed by

21/10/2016 15:39:40 |  | Project communication failed: attempting access to reference site
21/10/2016 15:39:42 |  | Internet access OK - project servers may be temporarily down.

Guess summats not quite right..

Regards,

 

Cliff,

Been there, Done that, Still no damm T Shirt.

Todderbert
Todderbert
Joined: 3 Jun 15
Posts: 1285
Credit: 645963019
RAC: 0

I'm getting similar results

I'm getting similar results over here.

10/21/2016 10:07:38 AM |  | Project communication failed: attempting access to reference site
10/21/2016 10:07:38 AM | Einstein@Home | Backing off 00:03:38 on upload of p2030.20141124.G193.37+00.98.S.b1s0g0.00000_3008_0_14
10/21/2016 10:07:40 AM |  | Internet access OK - project servers may be temporarily down.

cliff
cliff
Joined: 15 Feb 12
Posts: 176
Credit: 283452444
RAC: 0

Yeah, its a problem, I have

Yeah, its a problem, I have more than 10 WU trying to upload:-(

Last time I transient http errors it was SETI having network problems.. Not had this sorta thing with E@H though.

 

 

 

Cliff,

Been there, Done that, Still no damm T Shirt.

Sir Rodney Ffing
Sir Rodney Ffing
Joined: 8 Nov 15
Posts: 165
Credit: 473102
RAC: 0

Same problem. Transfers tab

Same problem. Transfers tab is saying 6 hour backoff. Want to shut down the computer long before that.

Mumak
Joined: 26 Feb 13
Posts: 325
Credit: 3292367803
RAC: 1515283

Seems the staff has left for

Seems the staff has left for weekend.. This will be a busy Monday ;-)

-----

Richard Haselgrove
Richard Haselgrove
Joined: 10 Dec 05
Posts: 2139
Credit: 2752801842
RAC: 1434584

BRP4G tasks are giving a

BRP4G tasks are giving a nasty http_debug error log when attempting uploads.


21/10/2016 18:22:13 | Einstein@Home | Started upload of p2030.20141201.G193.69-00.79.C.b2s0g0.00000_1440_0_1
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Info: Connection 1157 seems to be dead!
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Info: Closing connection 1157
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Info: Found bundle for host einstein3.aei.uni-hannover.de: 0x3eca770 [can pipeline]
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Info: Hostname einstein3.aei.uni-hannover.de was found in DNS cache
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Info: Trying 130.75.116.33...
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Info: Connected to einstein3.aei.uni-hannover.de (130.75.116.33) port 80 (#1159)
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Sent header to server: POST /EinsteinAtHome/cgi-bin/file_upload_handler_medium HTTP/1.1
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Sent header to server: Host: einstein3.aei.uni-hannover.de
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.7.0)
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Sent header to server: Accept: */*
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Sent header to server: Accept-Encoding: deflate, gzip
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Sent header to server: Content-Type: application/x-www-form-urlencoded
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Sent header to server: Accept-Language: en_GB
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Sent header to server: Content-Length: 4749
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Sent header to server: Expect: 100-continue
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Sent header to server:
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: HTTP/1.1 100 Continue
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Info: We are completely uploaded and fine
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: HTTP/1.1 404 Not Found
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: Server: nginx/1.2.1
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: Date: Fri, 21 Oct 2016 17:22:08 GMT
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: Content-Type: text/html
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: Content-Length: 168
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: Connection: close
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server:
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: <html>
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: <head><title>404 Not Found</title></head>
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: <body bgcolor="white">
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: <center><h1>404 Not Found</h1></center>
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: <hr><center>nginx/1.2.1</center>
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: </body>
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Received header from server: </html>
21/10/2016 18:22:13 | Einstein@Home | [http] [ID#1259] Info: Closing connection 1159
21/10/2016 18:22:14 | Einstein@Home | Backing off 00:10:43 on upload of p2030.20141201.G193.69-00.79.C.b2s0g0.00000_1440_0_1

HTTP/1.1 404 Not Found isn't a reassuring sign.

cliff
cliff
Joined: 15 Feb 12
Posts: 176
Credit: 283452444
RAC: 0

Seems to me that this is

Seems to me that this is pretty standard for faults, either during the weekend/holiday or just prior, when there is no one to deal with said problem.. Murphy has struck once again:-(

Cheers

Cliff,

Been there, Done that, Still no damm T Shirt.

James L. Neill
James L. Neill
Joined: 14 Dec 10
Posts: 13
Credit: 141558696
RAC: 0

Cliff, you forgot about

Cliff, you forgot about Murphy's little cousin called Sod! I cannot upload either

 

Richard Haselgrove
Richard Haselgrove
Joined: 10 Dec 05
Posts: 2139
Credit: 2752801842
RAC: 1434584

I think we might have

I think we might have clearance on this - five machines have all just uploaded and reported.

Kudos to whoever stayed late and fixed it.

James L. Neill
James L. Neill
Joined: 14 Dec 10
Posts: 13
Credit: 141558696
RAC: 0

I would second Richard's

I would second Richard's comment as my machine has just cleared. To whoever fixed things  a very big "Thank you"

morgan
morgan
Joined: 14 Dec 05
Posts: 2
Credit: 16981967
RAC: 0

Boinc-manager here says:

Boinc-manager here says: -Project file upload handler is missing-

So no upload from me either!

 

 

mmonnin
mmonnin
Joined: 29 May 16
Posts: 291
Credit: 3229520625
RAC: 1117429

All my units have uploaded in

All my units have uploaded in the past half hour or so after the down time.

morgan
morgan
Joined: 14 Dec 05
Posts: 2
Credit: 16981967
RAC: 0

After a forced retry(upload

After a forced retry(upload ,all seem`s to be working OK here again Smile

Thanks 

Oliver Behnke
Oliver Behnke
Moderator
Administrator
Joined: 4 Sep 07
Posts: 942
Credit: 25166626
RAC: 0

See  Let us know if you still

We did of course check the upload servers after their reboot and they worked just fine. They might have been overloaded at first or your clients might have went into their exponential back-off. Let us know if you still got stuck uploads...

Oliver

 

Einstein@Home Project

den777
den777
Joined: 29 May 13
Posts: 9
Credit: 45784648
RAC: 161663

>urgent security

>urgent security update

Dirty Cow vulnerabilty?  

Oliver Behnke
Oliver Behnke
Moderator
Administrator
Joined: 4 Sep 07
Posts: 942
Credit: 25166626
RAC: 0

Maybe 

Maybe Wink

 

Einstein@Home Project