Hi,
What does "------> Starting from scratch..." this mean, after checkpoints have been written roughly each minute. It seems to happen regularily. Is this a finished subtask which needs a new checkpoint file?
Regards,
Gunnar
<core_client_version>7.20.2</core_client_version> <![CDATA[ <stderr_txt> 5:36][9527][INFO ] Checkpoint committed! [14:56:38][9527][INFO ] Checkpoint committed! [14:57:40][9527][INFO ] Checkpoint committed! [14:58:44][9527][INFO ] Checkpoint committed!
...
[20:24:41][9527][INFO ] Checkpoint committed! [20:25:45][9527][INFO ] Checkpoint committed! [20:26:47][9527][INFO ] Checkpoint committed! [20:27:53][9527][INFO ] Checkpoint committed! [20:28:17][9527][INFO ] Statistics: count dirty SumSpec pages 360 (not checkpointed), Page Size 1024, fundamental_idx_hi-window_2: 329052 [20:28:17][9527][INFO ] Data processing finished successfully! [20:28:17][9527][INFO ] Starting data processing... [20:28:17][9527][INFO ] Checkpoint file unavailable: p2030.20191127.G184.70-00.58.N.b2s0g0.00000_2120.cpt (No such file or directory). ------> Starting from scratch... [20:28:17][9527][INFO ] Header contents: ------> Original WAPP file: ./p2030.20191127.G184.70-00.58.N.b2s0g0.00000_DM212.50 ------> Sample time in microseconds: 65.4762 ------> Observation time in seconds: 274.62705 ------> Time stamp (MJD): 58814.21584203044 ------> Number of samples/record: 0 ------> Center freq in MHz: 1214.289551 ------> Channel band in MHz: 0.336182022 ------> Number of channels/record: 960 ------> Nifs: 1 ------> RA (J2000): 55446.2099991 ------> DEC (J2000): 243828.9006 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: G184.70-00.58.N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 4194304 ------> Trial dispersion measure: 212.5 cm^-3 pc ------> Scale factor: 0.0012882 [20:28:17][9527][INFO ] Seed for random number generator is 1175555430. [20:28:29][9527][INFO ] Derived global search parameters: ------> f_A probability = 0.08 ------> single bin prob(P_noise > P_thr) = 1.32531e-08 ------> thr1 = 18.139 ------> thr2 = 21.241 ------> thr4 = 26.2686 ------> thr8 = 34.6478 ------> thr16 = 48.9581 [20:28:55][9527][INFO ] Checkpoint committed! [20:30:03][9527][INFO ] Checkpoint committed! [20:31:07][9527][INFO ] Checkpoint committed!
...
[01:41:12][9527][INFO ] Checkpoint committed! [01:42:14][9527][INFO ] Checkpoint committed! [01:43:16][9527][INFO ] Checkpoint committed! [01:44:20][9527][INFO ] Checkpoint committed! [01:44:55][9527][INFO ] Statistics: count dirty SumSpec pages 391 (not checkpointed), Page Size 1024, fundamental_idx_hi-window_2: 329052 [01:44:55][9527][INFO ] Data processing finished successfully! [01:44:55][9527][INFO ] Starting data processing... [01:44:55][9527][INFO ] Checkpoint file unavailable: p2030.20191127.G184.70-00.58.N.b2s0g0.00000_2120.cpt (No such file or directory). ------> Starting from scratch... [01:44:55][9527][INFO ] Header contents: ------> Original WAPP file: ./p2030.20191127.G184.70-00.58.N.b2s0g0.00000_DM212.60 ------> Sample time in microseconds: 65.4762 ------> Observation time in seconds: 274.62705 ------> Time stamp (MJD): 58814.215842028403 ------> Number of samples/record: 0 ------> Center freq in MHz: 1214.289551 ------> Channel band in MHz: 0.336182022 ------> Number of channels/record: 960 ------> Nifs: 1 ------> RA (J2000): 55446.2099991 ------> DEC (J2000): 243828.9006 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: G184.70-00.58.N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 4194304 ------> Trial dispersion measure: 212.6 cm^-3 pc ------> Scale factor: 0.00128824 [01:44:55][9527][INFO ] Seed for random number generator is 1173525504. [01:45:04][9527][INFO ] Derived global search parameters: ------> f_A probability = 0.08 ------> single bin prob(P_noise > P_thr) = 1.32531e-08 ------> thr1 = 18.139 ------> thr2 = 21.241 ------> thr4 = 26.2686 ------> thr8 = 34.6478 ------> thr16 = 48.9581 [01:45:23][9527][INFO ] Checkpoint committed! [01:46:27][9527][INFO ] Checkpoint committed! [01:47:32][9527][INFO ] Checkpoint committed! [01:48:34][9527][INFO ] Checkpoint committed!
Copyright © 2024 Einstein@Home. All rights reserved.
Gunnar Kaestle
)
Gary Roberts is an expert at reading these but I will give it a shot...you have to look at the lines above it as I cut out above....you can see it finished one part of the task on the line "[20:28:17][9527][INFO ] Data processing finished successfully!" and then it starts a new part of the task and looks for a checkpoint file but doesn't fine one and says "[20:28:17][9527][INFO ] Checkpoint file unavailable:". After that it reports the name of the checkpoint file and says "p2030.20191127.G184.70-00.58.N.b2s0g0.00000_2120.cpt (No such file or directory). ------> Starting from scratch..."
Thanks, Mikey, for the
)
Thanks, Mikey, for the explanation.
Gunnar