S5R5 Performance Analysis

hoarfrost
hoarfrost
Joined: 9 Feb 05
Posts: 207
Credit: 95807407
RAC: 118573

Hi! For statistics: My

Hi!

For statistics: My host 1275368 with S5R5 tasks.

Mike Hewson
Mike Hewson
Moderator
Joined: 1 Dec 05
Posts: 6542
Credit: 287055199
RAC: 97307

RE: Hi! For statistics: My

Message 90054 in response to message 90053

Quote:

Hi!

For statistics: My host 1275368 with S5R5 tasks.


Thanks, here's the data for completed WU's in RR format ( all designated as S5R5a )
[pre]
983.25, 1309, 23211.3
983.25, 1310, 23171.38
983.25, 1311, 23147.78
983.25, 1312, 23026.88
983.25, 1313, 23415.33
983.25, 1314, 23133.11
983.25, 1315, 23241.97
983.25, 1316, 23284.63
983.25, 1317, 20128.34
[/pre]
but thus far are too close in phase ( 0.602 - 0.630 ) to yield an estimate with RR V7G, yet. However I'll watch this machine as it is churning well and has 1301 thru 1308 pending for this frequency ( cycle period 284.5 ).

Cheers, Mike.

I have made this letter longer than usual because I lack the time to make it shorter ...

... and my other CPU is a Ryzen 5950X :-) Blaise Pascal

Bikeman (Heinz-Bernd Eggenstein)
Bikeman (Heinz-...
Moderator
Joined: 28 Aug 06
Posts: 3522
Credit: 691071364
RAC: 264742

It seems that ATLAS has

It seems that ATLAS has rejoined E@H and there should be many useful results to analyse there .

CU
Bikeman

Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5850
Credit: 110032356736
RAC: 22400038

RE: My Windows XP host

Quote:
My Windows XP host 1226365 has completed three S5R5 tasks, and is still showing a good selection of S5R4 v6.10 work. More S5R5 will be available for scrutiny in the morning. I'll try and write up some logs tomorrow, but you can start looking at the raw data now (and maybe save me a job!).

I've been pretty busy converting my fleet mid-cache so that they could start receiving R5 before they had completed the on-board R4 work. That was quite an effort that required surgery on every single host's state file. That is all completed but I don't have much R5 work done as yet because many of the hosts have continued to get R4 work. Not so much in the way of first time R4 tasks - they have essentially dried up - but moreso in the way of R4 resends! They have been becoming more prolific as the days have passed. Maybe a lot of people simply aborted their old R4 work so as to get some new R5.

In fact the very last machine I converted was down to its last R4 task and had been getting refused for new R4 work for a couple of days. Immediately the conversion was finished, I expected it to get R5 work straight away but upon restarting BOINC and enabling work fetch, it received a bunch of R4 resends complete with new large data files. It had been working on a 103x.xx frequency band so I knew there would be a complete change in frequency since there are no R5 tasks over 1000Hz at the moment. I was expecting a much lower frequency so was quite surprised when 119x.xx data started arriving with the R4 resend tasks. I was curious to see how much work there was so I increased my cache in stages and ended up with 10 days worth of R4 resends before finally getting an R5 task.

I have noticed on other machines that have been getting R5 new tasks for a while, that quite frequently R4 resends will come along as well.

Now that I've got a bit more time, I've dusted off my data gathering shell script and Bikeman's awk script and tried them out on R5. I needed to edit Bikeman's script for R5 but my shell script seems to be working OK.

So here is the data from Richard's host so far, suitable for feeding into Mike Hewson's RR. The CSV data is Frequency, Sequence#, Crunch time, App Version.

0941.40,0550,31263,6.10
0941.40,0551,30309,6.10
0941.40,0552,29681,6.10
0941.40,0553,30466,6.10
0941.40,0554,29638,6.10
0941.40,0555,29138,6.10
0941.40,0556,30050,6.10
0941.40,0557,28804,6.10
0941.40,0567,30073,6.10
0941.40,1206,22836,3.01
0941.40,1207,24382,3.01
0941.40,1208,24365,3.01
0941.40,1209,23965,3.01
0941.40,1210,23660,3.01
0941.40,1211,23942,3.01
0941.40,1212,24024,3.01
0941.40,1213,23540,3.01
0941.45,1804,23313,3.01
0941.45,1805,23173,3.01
0941.45,1806,23153,3.01
0941.45,1807,23341,3.01
0941.45,1808,23381,3.01
0941.45,1809,24276,3.01
0941.45,1810,24380,3.01
0941.45,1811,23411,3.01
0941.45,1812,23480,3.01
0941.45,1813,23871,3.01
0941.45,1814,23749,3.01
0941.45,1815,23064,3.01
0941.45,1816,23324,3.01
0941.45,1817,23171,3.01
0941.45,1818,22532,3.01
0941.45,1819,23785,3.01
0941.45,1820,23532,3.01
0941.50,1202,23134,3.01
0941.50,1203,23330,3.01
0941.50,1204,23473,3.01
0941.50,1205,22029,3.01
0941.50,1207,23228,3.01
0941.55,1188,23724,3.01
0941.55,1189,22035,3.01
0941.55,1190,22032,3.01
0941.55,1191,22028,3.01
0941.55,1192,20911,3.01
0941.55,1193,21896,3.01
0941.55,1194,22271,3.01
0941.55,1198,22493,3.01
0941.55,1199,21293,3.01
0941.55,1200,20931,3.01
0941.55,1202,21552,3.01
0941.55,1205,23152,3.01

I had tested things out using one of my hosts that had done a bit of R5 work, It's an old AMD64 3800+ dual core.

0701.05,0195,40419,6.02
0701.10,0290,47256,6.02
0701.10,0291,48259,6.02
0701.10,0292,48709,6.02
0701.10,0298,47889,6.02
0701.10,0300,47480,6.02
0701.10,0301,47290,6.02
0701.10,0310,45592,6.02
0701.10,0321,42080,6.02
0701.10,0328,42838,6.02
0701.10,0329,40560,6.02
0701.10,0330,41309,6.02
0701.10,0331,40982,6.02
0701.10,0332,40407,6.02
0701.10,0333,41167,6.02
0701.10,0334,39781,6.02
0701.10,0337,40667,6.02
0701.10,0614,21753,1.01
0701.10,0615,29370,1.01
0701.10,0616,22627,1.01
0701.10,0617,29110,1.01
0701.15,0588,27709,1.01
0701.15,0589,19798,1.01
0701.15,0590,25565,1.01
0701.15,0591,25895,1.01
0701.15,0592,20351,1.01
0701.15,0593,29025,1.01
0701.15,0594,22467,1.01
0701.15,0595,24991,1.01
0701.15,0596,28163,1.01
0701.15,0597,20526,1.01
0701.15,0598,29377,1.01

I decided to include this data as well because it shows the two expected features of R5, firstly that crunch times will be a lot less and secondly that there will be larger swings between peaks and troughs. That certainly seems to be the case with this initial set of results.

Cheers,
Gary.

Richard Haselgrove
Richard Haselgrove
Joined: 10 Dec 05
Posts: 2142
Credit: 2774501693
RAC: 845001

Thanks Gary - I was away for

Thanks Gary - I was away for the weekend, and I've been busy since I got back. Just beginning to think I should start scraping data before it starts to purge, and there is it ready for me. Brilliant.

archae86
archae86
Joined: 6 Dec 05
Posts: 3146
Credit: 7060334931
RAC: 1149571

As with most of us, my hosts

As with most of us, my hosts seemed to draw a rather thin mix of work very near cycle peaks at first. So I did not make any graphs or do other work.

Just now I took another look, and saw that two hosts have seen work appreciably away from cycle peak.

The execution times drop considerably, but on first look I'm getting much more like a cloud than a nice pretty clean curve.

Here is all the 3.01 available for my premium host, a Q9550 running stock.

748.70,1128,18395.39,3.01
748.70,1126,19039.17,3.01
748.70,1125,19508.19,3.01
748.70,1124,19428.27,3.01
748.75,742,19556.92,3.01
748.75,739,18717.72,3.01
748.75,738,18879.88,3.01
748.75,737,19388.22,3.01
748.80,751,20365.67,3.01
748.85,1128,20024.42,3.01
748.85,1127,19568.47,3.01
748.85,1126,19632.17,3.01
748.85,1125,19038.58,3.01
748.85,1124,19005.83,3.01
748.85,1123,18931.72,3.01
748.85,1122,18874.41,3.01
748.85,1121,18694.47,3.01
748.85,1120,18765.48,3.01
748.85,1119,18805.02,3.01
748.85,1118,18820.81,3.01
748.85,1117,17797.83,3.01
748.85,1116,17852.08,3.01
748.85,1115,18451.53,3.01
748.90,750,19208.48,3.01
748.90,749,19117.73,3.01
748.90,748,19222.70,3.01
748.90,747,19180.06,3.01
748.90,746,19111.48,3.01
748.95,1128,19229.63,3.01
748.95,1127,19115.70,3.01
748.95,1126,18936.08,3.01
748.95,1125,18963.16,3.01
748.95,1124,18674.94,3.01
748.95,1123,18614.03,3.01
748.95,1122,18824.78,3.01
749.00,738,18157.91,3.01
749.00,737,18553.81,3.01
749.00,736,18876.42,3.01
749.05,752,19327.86,3.01
749.05,751,19428.81,3.01
749.05,750,19153.94,3.01
749.05,749,19030.92,3.01
749.05,748,18948.91,3.01
749.05,747,18894.81,3.01
749.05,746,18727.89,3.01
749.05,745,18501.83,3.01
749.05,744,18499.36,3.01
749.05,743,18585.66,3.01
749.05,742,19211.72,3.01
749.10,1128,20257.13,3.01
749.15,748,20137.98,3.01
749.15,747,20448.22,3.01
749.20,1126,20302.63,3.01
749.20,1125,20496.91,3.01
749.25,748,19688.52,3.01
749.25,747,19936.20,3.01
749.25,746,20518.47,3.01
749.25,745,20323.80,3.01
749.25,744,19720.17,3.01
749.25,743,20150.63,3.01
749.25,742,19579.00,3.01
749.25,741,19991.59,3.01
749.25,740,19842.88,3.01
749.25,739,19003.75,3.01
749.25,738,18638.91,3.01
749.25,737,19367.02,3.01
749.25,736,19379.84,3.01
749.25,735,18204.80,3.01
749.25,734,18454.97,3.01
749.25,733,19484.64,3.01
749.25,732,18135.53,3.01
749.25,731,19013.28,3.01
749.25,730,19571.47,3.01
749.35,1124,19943.16,3.01
749.35,1121,19559.03,3.01
749.35,1120,19200.78,3.01
749.35,1118,19235.58,3.01
749.35,1123,18627.64,3.01
749.35,1117,17458.80,3.01
749.35,1116,18025.52,3.01
749.35,1115,18766.25,3.01
749.35,1114,18984.44,3.01
749.40,740,19130.50,3.01
749.40,739,18570.83,3.01
749.40,738,18595.53,3.01
749.40,737,19177.75,3.01
749.40,736,19112.89,3.01
749.40,755,19958.67,3.01
749.45,1115,19615.80,3.01
749.45,1112,18471.06,3.01
749.45,1114,19417.75,3.01
749.45,1111,19531.80,3.01
749.45,1110,17721.78,3.01
749.45,1109,18172.81,3.01
749.50,704,17246.64,3.01
749.50,703,16389.73,3.01
749.50,702,16301.50,3.01
749.50,696,14366.97,3.01
749.50,701,17439.83,3.01
749.50,695,17599.33,3.01
749.50,694,15856.44,3.01
749.50,693,15432.19,3.01
749.50,691,13622.30,3.01
749.50,689,13724.88,3.01
749.50,684,12787.42,3.01
749.50,686,13999.41,3.01
749.50,682,14993.50,3.01
749.50,681,14339.23,3.01
749.50,678,16967.00,3.01
749.50,677,14659.98,3.01
749.50,676,14010.39,3.01
749.50,674,12472.39,3.01
749.50,673,16487.22,3.01
749.50,672,15929.63,3.01
749.50,668,15329.38,3.01
749.50,670,17765.68,3.01
749.50,666,12140.33,3.01
749.50,664,14980.73,3.01
749.50,665,16852.92,3.01
749.50,663,12857.25,3.01
749.60,1116,17895.75,3.01
749.60,1115,18405.22,3.01
749.60,1114,18681.17,3.01
749.60,1112,17954.86,3.01
749.60,1111,18610.69,3.01
749.60,1109,17065.16,3.01
749.60,1107,15838.34,3.01
749.60,1108,17983.06,3.01

By contrast, here is late-season 6.05 from the same host, at the same settings

748.20,271,22920.50,6.05
748.20,269,22327.70,6.05
748.20,268,22843.17,6.05
748.20,267,22145.09,6.05
748.20,266,22177.73,6.05
748.20,322,25869.97,6.05
748.20,265,22658.16,6.05
748.20,264,22176.16,6.05
748.20,263,22237.25,6.05
748.25,230,22013.47,6.05
748.25,177,25384.34,6.05
748.25,176,25369.70,6.05
748.25,175,25324.83,6.05
748.25,174,25845.11,6.05
748.25,173,25565.73,6.05
748.25,172,25698.25,6.05
748.25,171,25842.28,6.05
748.25,170,25787.16,6.05
748.25,169,25978.03,6.05
748.25,168,26209.56,6.05
748.25,167,26754.28,6.05
748.30,442,22081.56,6.05
748.30,441,23525.00,6.05
748.30,440,22753.44,6.05
748.30,439,22368.97,6.05
748.30,438,23256.89,6.05
748.30,437,22399.98,6.05
748.30,436,22803.30,6.05
748.30,435,23208.80,6.05
748.35,254,22524.58,6.05
748.35,253,22417.52,6.05
748.35,252,22113.53,6.05
748.35,251,22781.66,6.05
748.35,249,22272.06,6.05
748.40,276,22556.73,6.05
748.40,275,22602.31,6.05
748.40,274,22925.59,6.05
748.40,271,22850.53,6.05
748.40,273,22010.38,6.05
748.40,272,22680.16,6.05
748.40,268,22932.48,6.05
748.40,267,22064.17,6.05
748.40,266,22536.78,6.05
748.40,265,22897.34,6.05
748.45,245,22040.27,6.05
748.45,242,22356.75,6.05
748.45,241,22330.73,6.05
748.45,240,22277.14,6.05
748.45,238,22472.59,6.05
748.45,237,22103.66,6.05
748.45,235,22421.61,6.05
748.45,234,22030.55,6.05
748.45,229,22797.08,6.05
748.45,228,22708.31,6.05
748.45,227,22031.47,6.05
748.45,223,22364.81,6.05
748.45,222,22801.14,6.05
748.45,221,21664.70,6.05
748.45,220,22796.23,6.05
748.45,219,22844.55,6.05
748.50,228,22552.64,6.05
748.50,227,22198.02,6.05
748.50,226,22701.80,6.05
748.50,225,22577.05,6.05

As this machine is actually used by two people for web browsing and document composition, it is possible that a difference in the state of those activities accounts for this (or maybe I just flubbed graph-making). But it would be interesting if others see such an effect.

Bikeman (Heinz-Bernd Eggenstein)
Bikeman (Heinz-...
Moderator
Joined: 28 Aug 06
Posts: 3522
Credit: 691071364
RAC: 264742

Quite useful data, here are

Quite useful data, here are graphs for the S5R4 data


Min frequency in data           :  748.20
Max frequency in data           :  748.50
Min predicted runtime           :   22220
Min observed runtime            :   21665
Max predicted runtime           :   26583
Max observed runtime            :   26754
Rel. predicted runtime variation:   1.196
Mean predicted runtime          :   23674

and for the S5R5 datapoints

Min frequency in data           :  748.70
Max frequency in data           :  749.60
Min predicted runtime           :   12235
Min observed runtime            :   12140
Max predicted runtime           :   20138
Max observed runtime            :   20518
Rel. predicted runtime variation:   1.646
Mean predicted runtime          :   14870

The S5R5 datapoints are far more unregular, not surprising as there are now far fewer skypoints per WU to average out variations in runtime for individual skypoints.

CU
Bikeman

Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5850
Credit: 110032356736
RAC: 22400038

RE: Quite useful data, here

Message 90060 in response to message 90059

Quote:

Quite useful data, here are graphs for the S5R4 data ...

and for the S5R5 datapoints ...

As you say, quite interesting. If you look at the S5R5 plot in the top right corner where there is a high density of points, you can see several (at least 5) groups of points that follow a straight line relatively close to parallel to the average line you have included. I haven't checked but this suggests to me that each separate frequency sub-band has a slightly different performance, some a bit quicker than average and some a bit slower. I'm assuming that a set of points clearly on their own particular straight line all belong to a single frequency.

EDIT: Is it possible to colour code the plotted points according to frequency?
Thanks.

Cheers,
Gary.

Bikeman (Heinz-Bernd Eggenstein)
Bikeman (Heinz-...
Moderator
Joined: 28 Aug 06
Posts: 3522
Credit: 691071364
RAC: 264742

RE: EDIT: Is it possible

Message 90061 in response to message 90060

Quote:

EDIT: Is it possible to colour code the plotted points according to frequency?
Thanks.

Don't know how to do it in octave, but then there's TOPCAT as well :-)


Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5850
Credit: 110032356736
RAC: 22400038

RE: RE: EDIT: Is it

Message 90062 in response to message 90061

Quote:
Quote:

EDIT: Is it possible to colour code the plotted points according to frequency?
Thanks.

Don't know how to do it in octave, but then there's TOPCAT as well :-)


Thanks very much for doing that! As seemed likely, there are a number of results of single frequency (colour) that fall on mini straight line segments. Then there are others that decidedly don't. For example, there are two frequencies that plot as red, 748.70Hz and 749.60. There are twelve points in total and a lot of scatter in the crunch times. No real order to those values.

In the bottom left corner there are a whole range of magenta points which must all be 749.50Hz. The seq#s are all heading down towards a trough but the crunch times show a huge variation, from just over 12ksecs to nearly 18Ksecs. I guess it must be just about impossible to come up with an algorithm for assigning fair credit with such a huge variation.

Cheers,
Gary.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.