Times (Elapsed / CPU) for BRP5/6/6-Beta on various CPU/GPU combos - DISCUSSION Thread
Language
Copyright © 2024 Einstein@Home. All rights reserved.
Copyright © 2024 Einstein@Home. All rights reserved.
Well, luckily I just sold the
)
Well, luckily I just sold the 750 Ti for exactly the same price I bought it 10 months ago - because of currency loss. So all I paid was the energy, which I would have to pay anyway to heat the house.
But I just found out I'm in the wrong thread. So I'll start a new one in september/october :)
Thanks ETA/MrS and archae86 -
)
Thanks ETA/MrS and archae86 - I do use Lasso @abovenormal priority (which matches my cuda.cfg settings at seti)-not that it yields the same results but close as I can get.
Actual CPU usage as reported by Lasso hovers at 3-4% on BRP6
I am using the Stock config of .2 CPU + 1 GPU
My initial query was actually a reference to *increasing GPU Load.
CUDA apps at seti (CUDA50) use a 0.04 CPU config.
I do run them with .5 GPU (2up or 2X) - and the GPU Load presents at 97%
with 637MB VRAM use - vs 301MB mem use and 80% GPU Load with a single instance of BRP6
=
Previous runtimes of 1.42/1.52? Betas averaged 1:45-54
Since 1.52 Stock - runtimes have increased to 2:05 avg
However I believe this attributable to stderr note re: "missing checkpoint..."
albeit an unexpected increase vs expected decrease IMHO
Forgive the verbosity - here
)
Forgive the verbosity - here is stderr from task finished 5 minutes ago:
Runtime - 2:03
=
Task 497171352
PM0021_001B1_104_0
Stderr output
7.4.42
Activated exception handling...
[11:43:04][7096][INFO ] Starting data processing...
[11:43:04][7096][INFO ] CUDA global memory status (initial GPU state,
including context):
------> Used in total: 166 MB (1883 MB free / 2049 MB total) -> Used by
this application (assuming a single GPU task): 0 MB
[11:43:04][7096][INFO ] Using CUDA device #0 "GeForce GTX 960"
(1024 CUDA cores / -1676.60 GFLOPS)
[11:43:04][7096][INFO ] Version of installed CUDA driver: 7000
[11:43:04][7096][INFO ] Version of CUDA driver API used: 3020
[11:43:05][7096][INFO ] Checkpoint file unavailable: status.cpt (No
such file or directory).
------> Starting from scratch...
[11:43:05][7096][INFO ] Header contents:
------> Original WAPP file: ./PM0021_001B1_DM208.00
------> Sample time in microseconds: 1000
------> Observation time in seconds: 2097.152
------> Time stamp (MJD): 50742.996742419949
------> Number of samples/record: 0
------> Center freq in MHz: 1231.5
------> Channel band in MHz: 3
------> Number of channels/record: 96
------> Nifs: 1
------> RA (J2000): 161027.251301
------> DEC (J2000): -511700.082
------> Galactic l: 0
------> Galactic b: 0
------> Name: G4877501
------> Lagformat: 0
------> Sum: 1
------> Level: 3
------> AZ at start: 0
------> ZA at start: 0
------> AST at start: 0
------> LST at start: 0
------> Project ID: --
------> Observers: --
------> File size (bytes): 0
------> Data size (bytes): 0
------> Number of samples: 2097152
------> Trial dispersion measure: 208 cm^-3 pc
------> Scale factor: 1.36291
[11:43:05][7096][INFO ] Seed for random number generator is
1089129141.
[11:43:06][7096][INFO ] Derived global search parameters:
------> f_A probability = 0.04
------> single bin prob(P_noise > P_thr) = 1.2977e-008
------> thr1 = 18.1601
------> thr2 = 21.263
------> thr4 = 26.2923
------> thr8 = 34.674
------> thr16 = 48.9881
[11:43:06][7096][INFO ] CUDA global memory status (GPU setup
complete):
------> Used in total: 301 MB (1748 MB free / 2049 MB total) -> Used by
this application (assuming a single GPU task): 135 MB
[11:44:09][7096][INFO ] Checkpoint committed!
[11:45:14][7096][INFO ] Checkpoint committed!
[11:46:20][7096][INFO ] Checkpoint committed!
[11:47:25][7096][INFO ] Checkpoint committed!
[11:48:31][7096][INFO ] Checkpoint committed!
[11:49:36][7096][INFO ] Checkpoint committed!
[11:50:42][7096][INFO ] Checkpoint committed!
[11:51:47][7096][INFO ] Checkpoint committed!
[11:52:53][7096][INFO ] Checkpoint committed!
[11:53:58][7096][INFO ] Checkpoint committed!
[11:55:04][7096][INFO ] Checkpoint committed!
[11:56:09][7096][INFO ] Checkpoint committed!
[11:57:15][7096][INFO ] Checkpoint committed!
[11:58:20][7096][INFO ] Checkpoint committed!
[11:59:26][7096][INFO ] Checkpoint committed!
[12:00:31][7096][INFO ] Checkpoint committed!
[12:01:36][7096][INFO ] Checkpoint committed!
[12:02:41][7096][INFO ] Checkpoint committed!
[12:03:46][7096][INFO ] Checkpoint committed!
[12:04:51][7096][INFO ] Checkpoint committed!
[12:05:52][7096][INFO ] Checkpoint committed!
[12:06:52][7096][INFO ] Checkpoint committed!
[12:07:52][7096][INFO ] Checkpoint committed!
[12:08:52][7096][INFO ] Checkpoint committed!
[12:09:55][7096][INFO ] Checkpoint committed!
[12:11:01][7096][INFO ] Checkpoint committed!
[12:12:06][7096][INFO ] Checkpoint committed!
[12:13:12][7096][INFO ] Checkpoint committed!
[12:14:17][7096][INFO ] Checkpoint committed!
[12:15:23][7096][INFO ] Checkpoint committed!
[12:16:26][7096][INFO ] Checkpoint committed!
[12:17:27][7096][INFO ] Checkpoint committed!
[12:18:27][7096][INFO ] Checkpoint committed!
[12:19:27][7096][INFO ] Checkpoint committed!
[12:20:27][7096][INFO ] Checkpoint committed!
[12:21:31][7096][INFO ] Checkpoint committed!
[12:22:37][7096][INFO ] Checkpoint committed!
[12:23:42][7096][INFO ] Checkpoint committed!
[12:24:48][7096][INFO ] Checkpoint committed!
[12:25:53][7096][INFO ] Checkpoint committed!
[12:26:59][7096][INFO ] Checkpoint committed!
[12:28:04][7096][INFO ] Checkpoint committed!
[12:29:10][7096][INFO ] Checkpoint committed!
[12:30:15][7096][INFO ] Checkpoint committed!
[12:31:21][7096][INFO ] Checkpoint committed!
[12:32:26][7096][INFO ] Checkpoint committed!
[12:33:32][7096][INFO ] Checkpoint committed!
[12:34:37][7096][INFO ] Checkpoint committed!
[12:35:43][7096][INFO ] Checkpoint committed!
[12:36:48][7096][INFO ] Checkpoint committed!
[12:37:54][7096][INFO ] Checkpoint committed!
[12:39:00][7096][INFO ] Checkpoint committed!
[12:40:05][7096][INFO ] Checkpoint committed!
[12:41:11][7096][INFO ] Checkpoint committed!
[12:42:16][7096][INFO ] Checkpoint committed!
[12:43:22][7096][INFO ] Checkpoint committed!
[12:44:27][7096][INFO ] Checkpoint committed!
[12:45:02][7096][INFO ] Statistics: count dirty SumSpec pages 2332075
(not checkpointed), Page Size 1024, fundamental_idx_hi-window_2:
1886937
[12:45:02][7096][INFO ] Data processing finished successfully!
[12:45:02][7096][INFO ] Starting data processing...
[12:45:02][7096][INFO ] CUDA global memory status (initial GPU state,
including context):
------> Used in total: 166 MB (1883 MB free / 2049 MB total) -> Used by
this application (assuming a single GPU task): 0 MB
[12:45:02][7096][INFO ] Using CUDA device #0 "GeForce GTX 960"
(1024 CUDA cores / -1676.60 GFLOPS)
[12:45:02][7096][INFO ] Version of installed CUDA driver: 7000
[12:45:02][7096][INFO ] Version of CUDA driver API used: 3020
[12:45:03][7096][INFO ] Checkpoint file unavailable: status.cpt (No
such file or directory).
------> Starting from scratch...
[12:45:03][7096][INFO ] Header contents:
------> Original WAPP file: ./PM0021_001B1_DM210.00
------> Sample time in microseconds: 1000
------> Observation time in seconds: 2097.152
------> Time stamp (MJD): 50742.996742378193
------> Number of samples/record: 0
------> Center freq in MHz: 1231.5
------> Channel band in MHz: 3
------> Number of channels/record: 96
------> Nifs: 1
------> RA (J2000): 161027.251301
------> DEC (J2000): -511700.082
------> Galactic l: 0
------> Galactic b: 0
------> Name: G4877501
------> Lagformat: 0
------> Sum: 1
------> Level: 3
------> AZ at start: 0
------> ZA at start: 0
------> AST at start: 0
------> LST at start: 0
------> Project ID: --
------> Observers: --
------> File size (bytes): 0
------> Data size (bytes): 0
------> Number of samples: 2097152
------> Trial dispersion measure: 210 cm^-3 pc
------> Scale factor: 1.36271
[12:45:03][7096][INFO ] Seed for random number generator is
1090594665.
[12:45:04][7096][INFO ] Derived global search parameters:
------> f_A probability = 0.04
------> single bin prob(P_noise > P_thr) = 1.2977e-008
------> thr1 = 18.1601
------> thr2 = 21.263
------> thr4 = 26.2923
------> thr8 = 34.674
------> thr16 = 48.9881
[12:45:04][7096][INFO ] CUDA global memory status (GPU setup
complete):
------> Used in total: 301 MB (1748 MB free / 2049 MB total) -> Used by
this application (assuming a single GPU task): 135 MB
[12:45:33][7096][INFO ] Checkpoint committed!
[12:46:38][7096][INFO ] Checkpoint committed!
[12:47:44][7096][INFO ] Checkpoint committed!
[12:48:49][7096][INFO ] Checkpoint committed!
[12:49:55][7096][INFO ] Checkpoint committed!
[12:51:00][7096][INFO ] Checkpoint committed!
[12:52:06][7096][INFO ] Checkpoint committed!
[12:53:11][7096][INFO ] Checkpoint committed!
[12:54:17][7096][INFO ] Checkpoint committed!
[12:55:22][7096][INFO ] Checkpoint committed!
[12:56:28][7096][INFO ] Checkpoint committed!
[12:57:33][7096][INFO ] Checkpoint committed!
[12:58:39][7096][INFO ] Checkpoint committed!
[12:59:44][7096][INFO ] Checkpoint committed!
[13:00:50][7096][INFO ] Checkpoint committed!
[13:01:55][7096][INFO ] Checkpoint committed!
[13:03:01][7096][INFO ] Checkpoint committed!
[13:04:07][7096][INFO ] Checkpoint committed!
[13:05:12][7096][INFO ] Checkpoint committed!
[13:06:18][7096][INFO ] Checkpoint committed!
[13:07:23][7096][INFO ] Checkpoint committed!
[13:08:29][7096][INFO ] Checkpoint committed!
[13:09:34][7096][INFO ] Checkpoint committed!
[13:10:40][7096][INFO ] Checkpoint committed!
[13:11:45][7096][INFO ] Checkpoint committed!
[13:12:51][7096][INFO ] Checkpoint committed!
[13:13:56][7096][INFO ] Checkpoint committed!
[13:15:02][7096][INFO ] Checkpoint committed!
[13:16:07][7096][INFO ] Checkpoint committed!
[13:17:13][7096][INFO ] Checkpoint committed!
[13:18:18][7096][INFO ] Checkpoint committed!
[13:19:24][7096][INFO ] Checkpoint committed!
[13:20:29][7096][INFO ] Checkpoint committed!
[13:21:35][7096][INFO ] Checkpoint committed!
[13:22:40][7096][INFO ] Checkpoint committed!
[13:23:46][7096][INFO ] Checkpoint committed!
[13:24:51][7096][INFO ] Checkpoint committed!
[13:25:57][7096][INFO ] Checkpoint committed!
[13:27:02][7096][INFO ] Checkpoint committed!
[13:28:08][7096][INFO ] Checkpoint committed!
[13:29:14][7096][INFO ] Checkpoint committed!
[13:30:19][7096][INFO ] Checkpoint committed!
[13:31:25][7096][INFO ] Checkpoint committed!
[13:32:30][7096][INFO ] Checkpoint committed!
[13:33:36][7096][INFO ] Checkpoint committed!
[13:34:41][7096][INFO ] Checkpoint committed!
[13:35:47][7096][INFO ] Checkpoint committed!
[13:36:52][7096][INFO ] Checkpoint committed!
[13:37:58][7096][INFO ] Checkpoint committed!
[13:39:03][7096][INFO ] Checkpoint committed!
[13:40:09][7096][INFO ] Checkpoint committed!
[13:41:14][7096][INFO ] Checkpoint committed!
[13:42:20][7096][INFO ] Checkpoint committed!
[13:43:25][7096][INFO ] Checkpoint committed!
Activated exception handling...
[13:43:39][4924][INFO ] Output file:
'../../projects/einstein.phys.uwm.edu/PM0021_001B1_104_0_0' already
exists - skipping pass
[13:43:39][4924][INFO ] Starting data processing...
[13:43:40][4924][INFO ] CUDA global memory status (initial GPU state,
including context):
------> Used in total: 166 MB (1883 MB free / 2049 MB total) -> Used by
this application (assuming a single GPU task): 0 MB
[13:43:40][4924][INFO ] Using CUDA device #0 "GeForce GTX 960"
(1024 CUDA cores / -1676.60 GFLOPS)
[13:43:40][4924][INFO ] Version of installed CUDA driver: 7000
[13:43:40][4924][INFO ] Version of CUDA driver API used: 3020
[13:43:40][4924][INFO ] Continuing work on
../../projects/einstein.phys.uwm.edu/PM0021_001B1_105.bin4 at
template no. 293663
[13:43:41][4924][INFO ] Header contents:
------> Original WAPP file: ./PM0021_001B1_DM210.00
------> Sample time in microseconds: 1000
------> Observation time in seconds: 2097.152
------> Time stamp (MJD): 50742.996742378193
------> Number of samples/record: 0
------> Center freq in MHz: 1231.5
------> Channel band in MHz: 3
------> Number of channels/record: 96
------> Nifs: 1
------> RA (J2000): 161027.251301
------> DEC (J2000): -511700.082
------> Galactic l: 0
------> Galactic b: 0
------> Name: G4877501
------> Lagformat: 0
------> Sum: 1
------> Level: 3
------> AZ at start: 0
------> ZA at start: 0
------> AST at start: 0
------> LST at start: 0
------> Project ID: --
------> Observers: --
------> File size (bytes): 0
------> Data size (bytes): 0
------> Number of samples: 2097152
------> Trial dispersion measure: 210 cm^-3 pc
------> Scale factor: 1.36271
[13:43:41][4924][INFO ] Seed for random number generator is
1090594665.
[13:43:42][4924][INFO ] Derived global search parameters:
------> f_A probability = 0.04
------> single bin prob(P_noise > P_thr) = 1.2977e-008
------> thr1 = 18.1601
------> thr2 = 21.263
------> thr4 = 26.2923
------> thr8 = 34.674
------> thr16 = 48.9881
[13:43:42][4924][INFO ] CUDA global memory status (GPU setup
complete):
------> Used in total: 301 MB (1748 MB free / 2049 MB total) -> Used by
this application (assuming a single GPU task): 135 MB
[13:44:45][4924][INFO ] Checkpoint committed!
[13:45:50][4924][INFO ] Checkpoint committed!
[13:46:54][4924][INFO ] Statistics: count dirty SumSpec pages 115191
(not checkpointed), Page Size 1024, fundamental_idx_hi-window_2:
1886937
[13:46:54][4924][INFO ] Data processing finished successfully!
13:46:54 (4924): called boinc_finish(0)
RE: I am using the Stock
)
The influence of the parameter you quote on actual runtime performance is only felt through scheduling--it can influence how many simultaneous tasks of a given mix of task types BOINC chooses to start.
But at runtime it is in no sense an assignment or reservation of a given amount of CPU resource, so if it has a different value, but the number of tasks and types of tasks running are the same, I think you'll see no difference in performance.
Right. My concern is not
)
Right.
My concern is not about CPU usage - what with 3-4% avg use, on both BRP6 and CUDA50s at seti- it's so negligible.
I'm certain if I could increase GPU Load by *whatever means, runtimes would drop.
==
The stderr - Checkpoint file unavailable: status.cpt (No such file or directory).
And- Statistics: count dirty SumSpec pages 2332075
(not checkpointed), Page Size 1024, fundamental_idx_hi-window_2: 1886937
Are the *apparent reasons to *me for the runtime increase in *this case.
Maybe *this particular piece belongs in another Thread such as Problems/Bug reports.
=
But I'll ask while I'm *here; anyone else experiencing this?
Or know of a workaround?
=
Thanks for listening
RE: Checkpoint file
)
This part is easy: the WU is starting from scratch, so initially there is no checkpoint file. If you stop and restart a WU you'll see it progressing from the checkpoint.
About the other 2 points you mention: I don't know what they mean, sorry.
Generally I'm not convinced the runtime has increased from 1.52 beta to 1.52. I didn't read about any changes from 1.52 beta to 1.52, so I expect there were none. Which would make sense considering the identical version nubmer.
However, there is a stronger variability in runtimes since the new app. It depends on the data being crunched in an unpredictable way. You can see it in the scatter plots in the result thread, or in the plots of runtime vs. WU number. I don't know if you're looking at enough WUs to average this out.
MrS
Scanning for our furry friends since Jan 2002
Thanks for the look-see and
)
Thanks for the look-see and Notes MrS.
I see a checkpoint_debug diag flag in Advanced view but don't know *when it should be applied/attempted nor if this is the tool to correct the "error" and prevent the longer-running recalcs.
What are your thoughts about *that?
Thanks
Here's another - just
)
Here's another - just finished_ 1.935 hr runtime; but same "checkpoint file unavailable" output-- is this a quirk within the app code or cuda runtime or some such "other" problem or setting on my end that can be corrected?
=
Task 497568509
Name PM0022_061B1_82_0
Workunit 217651927
Created 6 May 2015 0:41:01 UTC
Sent 6 May 2015 2:13:05 UTC
Received 10 May 2015 17:31:47 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x0)
Computer ID 11709374
Report deadline 20 May 2015 2:13:05 UTC
Run time 6,966.27
CPU time 1,058.69
Validate state Valid
Claimed credit 8.30
Granted credit 4,400.00
application version Binary Radio Pulsar Search (Parkes PMPS XT) v1.52 (BRP6-cuda32-nv301)
Stderr output
7.4.42
Activated exception handling...
[10:35:28][7020][INFO ] Starting data processing...
[10:35:28][7020][INFO ] CUDA global memory status (initial GPU state, including context):
------> Used in total: 166 MB (1883 MB free / 2049 MB total) -> Used by this application (assuming a single GPU task): 0 MB
[10:35:28][7020][INFO ] Using CUDA device #0 "GeForce GTX 960" (1024 CUDA cores / -1676.60 GFLOPS)
[10:35:28][7020][INFO ] Version of installed CUDA driver: 7000
[10:35:28][7020][INFO ] Version of CUDA driver API used: 3020
[10:35:29][7020][INFO ] Checkpoint file unavailable: status.cpt (No such file or directory).
------> Starting from scratch...
[10:35:29][7020][INFO ] Header contents:
------> Original WAPP file: ./PM0022_061B1_DM164.00
------> Sample time in microseconds: 1000
------> Observation time in seconds: 2097.152
------> Time stamp (MJD): 50746.791284666964
------> Number of samples/record: 0
------> Center freq in MHz: 1231.5
------> Channel band in MHz: 3
------> Number of channels/record: 96
------> Nifs: 1
------> RA (J2000): 70401.3466001
------> DEC (J2000): -72836.3320007
------> Galactic l: 0
------> Galactic b: 0
------> Name: G4404497
------> Lagformat: 0
------> Sum: 1
------> Level: 3
------> AZ at start: 0
------> ZA at start: 0
------> AST at start: 0
------> LST at start: 0
------> Project ID: --
------> Observers: --
------> File size (bytes): 0
------> Data size (bytes): 0
------> Number of samples: 2097152
------> Trial dispersion measure: 164 cm^-3 pc
------> Scale factor: 1.37483
[10:35:29][7020][INFO ] Seed for random number generator is 1091282797.
[10:35:30][7020][INFO ] Derived global search parameters:
------> f_A probability = 0.04
------> single bin prob(P_noise > P_thr) = 1.2977e-008
------> thr1 = 18.1601
------> thr2 = 21.263
------> thr4 = 26.2923
------> thr8 = 34.674
------> thr16 = 48.9881
[10:35:30][7020][INFO ] CUDA global memory status (GPU setup complete):
------> Used in total: 301 MB (1748 MB free / 2049 MB total) -> Used by this application (assuming a single GPU task): 135 MB
[10:36:28][7020][INFO ] Checkpoint committed!
[10:37:29][7020][INFO ] Checkpoint committed!
[10:38:29][7020][INFO ] Checkpoint committed!
[10:39:30][7020][INFO ] Checkpoint committed!
[10:40:30][7020][INFO ] Checkpoint committed!
[10:41:31][7020][INFO ] Checkpoint committed!
[10:42:32][7020][INFO ] Checkpoint committed!
[10:43:32][7020][INFO ] Checkpoint committed!
[10:44:33][7020][INFO ] Checkpoint committed!
[10:45:33][7020][INFO ] Checkpoint committed!
[10:46:34][7020][INFO ] Checkpoint committed!
[10:47:35][7020][INFO ] Checkpoint committed!
[10:48:35][7020][INFO ] Checkpoint committed!
[10:49:36][7020][INFO ] Checkpoint committed!
[10:50:37][7020][INFO ] Checkpoint committed!
[10:51:38][7020][INFO ] Checkpoint committed!
[10:52:38][7020][INFO ] Checkpoint committed!
[10:53:39][7020][INFO ] Checkpoint committed!
[10:54:40][7020][INFO ] Checkpoint committed!
[10:55:40][7020][INFO ] Checkpoint committed!
[10:56:41][7020][INFO ] Checkpoint committed!
[10:57:42][7020][INFO ] Checkpoint committed!
[10:58:43][7020][INFO ] Checkpoint committed!
[10:59:43][7020][INFO ] Checkpoint committed!
[11:00:44][7020][INFO ] Checkpoint committed!
[11:01:45][7020][INFO ] Checkpoint committed!
[11:02:46][7020][INFO ] Checkpoint committed!
[11:03:46][7020][INFO ] Checkpoint committed!
[11:04:47][7020][INFO ] Checkpoint committed!
[11:05:48][7020][INFO ] Checkpoint committed!
[11:06:48][7020][INFO ] Checkpoint committed!
[11:07:48][7020][INFO ] Checkpoint committed!
[11:08:49][7020][INFO ] Checkpoint committed!
[11:09:50][7020][INFO ] Checkpoint committed!
[11:10:50][7020][INFO ] Checkpoint committed!
[11:11:50][7020][INFO ] Checkpoint committed!
[11:12:51][7020][INFO ] Checkpoint committed!
[11:13:51][7020][INFO ] Checkpoint committed!
[11:14:52][7020][INFO ] Checkpoint committed!
[11:15:53][7020][INFO ] Checkpoint committed!
[11:16:53][7020][INFO ] Checkpoint committed!
[11:17:54][7020][INFO ] Checkpoint committed!
[11:18:54][7020][INFO ] Checkpoint committed!
[11:19:54][7020][INFO ] Checkpoint committed!
[11:20:55][7020][INFO ] Checkpoint committed!
[11:21:56][7020][INFO ] Checkpoint committed!
[11:22:56][7020][INFO ] Checkpoint committed!
[11:23:57][7020][INFO ] Checkpoint committed!
[11:24:57][7020][INFO ] Checkpoint committed!
[11:25:58][7020][INFO ] Checkpoint committed!
[11:26:59][7020][INFO ] Checkpoint committed!
[11:28:00][7020][INFO ] Checkpoint committed!
[11:29:01][7020][INFO ] Checkpoint committed!
[11:30:02][7020][INFO ] Checkpoint committed!
[11:31:02][7020][INFO ] Checkpoint committed!
[11:32:03][7020][INFO ] Checkpoint committed!
[11:33:04][7020][INFO ] Checkpoint committed!
[11:33:12][7020][INFO ] Statistics: count dirty SumSpec pages 3800 (not checkpointed), Page Size 1024, fundamental_idx_hi-window_2: 1886937
[11:33:12][7020][INFO ] Data processing finished successfully!
[11:33:12][7020][INFO ] Starting data processing...
[11:33:12][7020][INFO ] CUDA global memory status (initial GPU state, including context):
------> Used in total: 166 MB (1883 MB free / 2049 MB total) -> Used by this application (assuming a single GPU task): 0 MB
[11:33:12][7020][INFO ] Using CUDA device #0 "GeForce GTX 960" (1024 CUDA cores / -1676.60 GFLOPS)
[11:33:12][7020][INFO ] Version of installed CUDA driver: 7000
[11:33:12][7020][INFO ] Version of CUDA driver API used: 3020
[11:33:13][7020][INFO ] Checkpoint file unavailable: status.cpt (No such file or directory).
------> Starting from scratch...
[11:33:13][7020][INFO ] Header contents:
------> Original WAPP file: ./PM0022_061B1_DM166.00
------> Sample time in microseconds: 1000
------> Observation time in seconds: 2097.152
------> Time stamp (MJD): 50746.791284625193
------> Number of samples/record: 0
------> Center freq in MHz: 1231.5
------> Channel band in MHz: 3
------> Number of channels/record: 96
------> Nifs: 1
------> RA (J2000): 70401.3466001
------> DEC (J2000): -72836.3320007
------> Galactic l: 0
------> Galactic b: 0
------> Name: G4404497
------> Lagformat: 0
------> Sum: 1
------> Level: 3
------> AZ at start: 0
------> ZA at start: 0
------> AST at start: 0
------> LST at start: 0
------> Project ID: --
------> Observers: --
------> File size (bytes): 0
------> Data size (bytes): 0
------> Number of samples: 2097152
------> Trial dispersion measure: 166 cm^-3 pc
------> Scale factor: 1.37476
[11:33:13][7020][INFO ] Seed for random number generator is 1080607893.
[11:33:15][7020][INFO ] Derived global search parameters:
------> f_A probability = 0.04
------> single bin prob(P_noise > P_thr) = 1.2977e-008
------> thr1 = 18.1601
------> thr2 = 21.263
------> thr4 = 26.2923
------> thr8 = 34.674
------> thr16 = 48.9881
[11:33:15][7020][INFO ] CUDA global memory status (GPU setup complete):
------> Used in total: 301 MB (1748 MB free / 2049 MB total) -> Used by this application (assuming a single GPU task): 135 MB
[11:34:04][7020][INFO ] Checkpoint committed!
[11:35:05][7020][INFO ] Checkpoint committed!
[11:36:06][7020][INFO ] Checkpoint committed!
[11:37:07][7020][INFO ] Checkpoint committed!
[11:38:07][7020][INFO ] Checkpoint committed!
[11:39:08][7020][INFO ] Checkpoint committed!
[11:40:09][7020][INFO ] Checkpoint committed!
[11:41:10][7020][INFO ] Checkpoint committed!
[11:42:10][7020][INFO ] Checkpoint committed!
[11:43:11][7020][INFO ] Checkpoint committed!
[11:44:11][7020][INFO ] Checkpoint committed!
[11:45:11][7020][INFO ] Checkpoint committed!
[11:46:12][7020][INFO ] Checkpoint committed!
[11:47:12][7020][INFO ] Checkpoint committed!
[11:48:13][7020][INFO ] Checkpoint committed!
[11:49:13][7020][INFO ] Checkpoint committed!
[11:50:14][7020][INFO ] Checkpoint committed!
[11:51:15][7020][INFO ] Checkpoint committed!
[11:52:15][7020][INFO ] Checkpoint committed!
[11:53:16][7020][INFO ] Checkpoint committed!
[11:54:17][7020][INFO ] Checkpoint committed!
[11:55:17][7020][INFO ] Checkpoint committed!
[11:56:18][7020][INFO ] Checkpoint committed!
[11:57:19][7020][INFO ] Checkpoint committed!
[11:58:19][7020][INFO ] Checkpoint committed!
[11:59:20][7020][INFO ] Checkpoint committed!
[12:00:21][7020][INFO ] Checkpoint committed!
[12:01:22][7020][INFO ] Checkpoint committed!
[12:02:22][7020][INFO ] Checkpoint committed!
[12:03:23][7020][INFO ] Checkpoint committed!
[12:04:24][7020][INFO ] Checkpoint committed!
[12:05:25][7020][INFO ] Checkpoint committed!
[12:06:25][7020][INFO ] Checkpoint committed!
[12:07:26][7020][INFO ] Checkpoint committed!
[12:08:27][7020][INFO ] Checkpoint committed!
[12:09:28][7020][INFO ] Checkpoint committed!
[12:10:29][7020][INFO ] Checkpoint committed!
[12:11:30][7020][INFO ] Checkpoint committed!
[12:12:30][7020][INFO ] Checkpoint committed!
[12:13:31][7020][INFO ] Checkpoint committed!
[12:14:32][7020][INFO ] Checkpoint committed!
[12:15:32][7020][INFO ] Checkpoint committed!
[12:16:33][7020][INFO ] Checkpoint committed!
[12:17:33][7020][INFO ] Checkpoint committed!
[12:18:34][7020][INFO ] Checkpoint committed!
[12:19:35][7020][INFO ] Checkpoint committed!
[12:20:35][7020][INFO ] Checkpoint committed!
[12:21:35][7020][INFO ] Checkpoint committed!
[12:22:36][7020][INFO ] Checkpoint committed!
[12:23:37][7020][INFO ] Checkpoint committed!
[12:24:37][7020][INFO ] Checkpoint committed!
[12:25:38][7020][INFO ] Checkpoint committed!
[12:26:38][7020][INFO ] Checkpoint committed!
[12:27:39][7020][INFO ] Checkpoint committed!
[12:28:40][7020][INFO ] Checkpoint committed!
[12:29:40][7020][INFO ] Checkpoint committed!
[12:30:41][7020][INFO ] Checkpoint committed!
[12:31:30][7020][INFO ] Statistics: count dirty SumSpec pages 5701 (not checkpointed), Page Size 1024, fundamental_idx_hi-window_2: 1886937
[12:31:30][7020][INFO ] Data processing finished successfully!
12:31:30 (7020): called boinc_finish(0)
Highlights: [10:35:29][7020][
)
Highlights:
[10:35:29][7020][INFO ] Checkpoint file unavailable: status.cpt (No such file or directory).------> Starting from scratch...
[10:35:29][7020][INFO ]
[11:33:12][7020][INFO ] Statistics: count dirty SumSpec pages 3800 (not checkpointed), Page Size 1024, fundamental_idx_hi-window_2: 1886937
===
------> Starting from scratch...
[11:33:13][7020][INFO ] Header contents
[12:31:30][7020][INFO ] Statistics: count dirty SumSpec pages 5701 (not checkpointed), Page Size 1024, fundamental_idx_hi-window_2: 1886937
===
I guess my question is: Is this Normal?
Ah, you're asking why it says
)
Ah, you're asking why it says "starting from scratch" again? Good catch, but it's normal :)
There are 2 analyses packaged into each WU to reduce the load on the database. I just compared both in one of my WUs and their header was identical except a different "Time stamp (MJD)". This means both analyses were performed on exactly the same spot in the sky, but one shortly after the other.
MrS
Scanning for our furry friends since Jan 2002