Task 1718660378
|
Ter5_1_dns_cfbf00113_segment_1_dms_200_40000_171_5850000_0
23 Jan 2025 4:33:37 UTC
23 Jan 2025 23:33:02 UTC
6 Feb 2025 23:33:02 UTC
1 Feb 2025 6:37:53 UTC
Over
Computation error
Compute error
-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
18.21
18.05
481.96
765.75
75.45
Invalid
0
Binary Radio Pulsar Search (MeerKAT) v0.12 (BRP7-cuda55)
windows_x86_64 |
Stderr output
<core_client_version>8.0.2</core_client_version> <![CDATA[ <message> too many boinc_temporary_exit()s</message> <stderr_txt> gh free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [15:17:52][7288][INFO ] Starting data processing... [15:17:52][7288][INFO ] CUDA device ID: 0 [15:17:52][7288][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [15:17:52][7288][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [15:17:52][7288][INFO ] Version of installed CUDA driver: 9010 [15:17:52][7288][INFO ] Version of CUDA driver API used: 3020 [15:18:06][7288][INFO ] Number of generated templates to be used: 50000 [15:18:06][7288][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [15:18:06][7288][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [15:18:06][7288][INFO ] Seed for random number generator is -1046983535. [15:18:11][7288][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [15:18:11][7288][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [15:18:11][7288][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [15:18:11][7288][ERROR] Demodulation failed (error: 1006)! [15:18:11][7288][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [15:33:30][9940][INFO ] Starting data processing... [15:33:31][9940][INFO ] CUDA device ID: 0 [15:33:31][9940][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [15:33:31][9940][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [15:33:31][9940][INFO ] Version of installed CUDA driver: 9010 [15:33:31][9940][INFO ] Version of CUDA driver API used: 3020 [15:33:44][9940][INFO ] Number of generated templates to be used: 50000 [15:33:44][9940][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [15:33:44][9940][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [15:33:44][9940][INFO ] Seed for random number generator is -1046983535. [15:33:49][9940][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [15:33:49][9940][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [15:33:49][9940][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [15:33:49][9940][ERROR] Demodulation failed (error: 1006)! [15:33:49][9940][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [15:49:09][14224][INFO ] Starting data processing... [15:49:09][14224][INFO ] CUDA device ID: 0 [15:49:09][14224][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [15:49:09][14224][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [15:49:09][14224][INFO ] Version of installed CUDA driver: 9010 [15:49:09][14224][INFO ] Version of CUDA driver API used: 3020 [15:49:23][14224][INFO ] Number of generated templates to be used: 50000 [15:49:23][14224][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [15:49:23][14224][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [15:49:23][14224][INFO ] Seed for random number generator is -1046983535. [15:49:28][14224][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [15:49:28][14224][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [15:49:28][14224][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [15:49:28][14224][ERROR] Demodulation failed (error: 1006)! [15:49:28][14224][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [16:04:34][14652][INFO ] Starting data processing... [16:04:34][14652][INFO ] CUDA device ID: 0 [16:04:35][14652][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [16:04:35][14652][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [16:04:35][14652][INFO ] Version of installed CUDA driver: 9010 [16:04:35][14652][INFO ] Version of CUDA driver API used: 3020 [16:05:08][14652][INFO ] Number of generated templates to be used: 50000 [16:05:08][14652][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [16:05:08][14652][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [16:05:09][14652][INFO ] Seed for random number generator is -1046983535. [16:05:13][14652][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [16:05:13][14652][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [16:05:14][14652][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [16:05:14][14652][ERROR] Demodulation failed (error: 1006)! [16:05:14][14652][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [16:20:18][10972][INFO ] Starting data processing... [16:20:18][10972][INFO ] CUDA device ID: 0 [16:20:18][10972][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [16:20:18][10972][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [16:20:18][10972][INFO ] Version of installed CUDA driver: 9010 [16:20:18][10972][INFO ] Version of CUDA driver API used: 3020 [16:20:52][10972][INFO ] Number of generated templates to be used: 50000 [16:20:52][10972][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [16:20:52][10972][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [16:20:52][10972][INFO ] Seed for random number generator is -1046983535. [16:20:57][10972][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [16:20:57][10972][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [16:20:57][10972][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [16:20:57][10972][ERROR] Demodulation failed (error: 1006)! [16:20:57][10972][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [16:36:00][6908][INFO ] Starting data processing... [16:36:00][6908][INFO ] CUDA device ID: 0 [16:36:00][6908][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [16:36:00][6908][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [16:36:00][6908][INFO ] Version of installed CUDA driver: 9010 [16:36:00][6908][INFO ] Version of CUDA driver API used: 3020 [16:36:34][6908][INFO ] Number of generated templates to be used: 50000 [16:36:34][6908][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [16:36:34][6908][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [16:36:34][6908][INFO ] Seed for random number generator is -1046983535. [16:36:39][6908][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [16:36:39][6908][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [16:36:39][6908][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [16:36:39][6908][ERROR] Demodulation failed (error: 1006)! [16:36:39][6908][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [16:51:43][6004][INFO ] Starting data processing... [16:51:44][6004][INFO ] CUDA device ID: 0 [16:51:44][6004][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [16:51:44][6004][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [16:51:44][6004][INFO ] Version of installed CUDA driver: 9010 [16:51:44][6004][INFO ] Version of CUDA driver API used: 3020 [16:52:18][6004][INFO ] Number of generated templates to be used: 50000 [16:52:18][6004][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [16:52:18][6004][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [16:52:18][6004][INFO ] Seed for random number generator is -1046983535. [16:52:23][6004][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [16:52:23][6004][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [16:52:23][6004][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [16:52:23][6004][ERROR] Demodulation failed (error: 1006)! [16:52:23][6004][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [17:07:27][8760][INFO ] Starting data processing... [17:07:27][8760][INFO ] CUDA device ID: 0 [17:07:27][8760][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [17:07:27][8760][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [17:07:27][8760][INFO ] Version of installed CUDA driver: 9010 [17:07:27][8760][INFO ] Version of CUDA driver API used: 3020 [17:08:01][8760][INFO ] Number of generated templates to be used: 50000 [17:08:01][8760][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [17:08:01][8760][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [17:08:01][8760][INFO ] Seed for random number generator is -1046983535. [17:08:06][8760][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [17:08:06][8760][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [17:08:06][8760][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [17:08:06][8760][ERROR] Demodulation failed (error: 1006)! [17:08:06][8760][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [17:23:14][2104][INFO ] Starting data processing... [17:23:14][2104][INFO ] CUDA device ID: 0 [17:23:14][2104][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [17:23:14][2104][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [17:23:14][2104][INFO ] Version of installed CUDA driver: 9010 [17:23:14][2104][INFO ] Version of CUDA driver API used: 3020 [17:23:48][2104][INFO ] Number of generated templates to be used: 50000 [17:23:48][2104][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [17:23:48][2104][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [17:23:48][2104][INFO ] Seed for random number generator is -1046983535. [17:23:53][2104][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [17:23:53][2104][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [17:23:53][2104][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [17:23:53][2104][ERROR] Demodulation failed (error: 1006)! [17:23:53][2104][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [17:38:55][14936][INFO ] Starting data processing... [17:38:55][14936][INFO ] CUDA device ID: 0 [17:38:55][14936][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [17:38:55][14936][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [17:38:55][14936][INFO ] Version of installed CUDA driver: 9010 [17:38:55][14936][INFO ] Version of CUDA driver API used: 3020 [17:39:29][14936][INFO ] Number of generated templates to be used: 50000 [17:39:29][14936][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [17:39:29][14936][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [17:39:29][14936][INFO ] Seed for random number generator is -1046983535. [17:39:34][14936][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [17:39:34][14936][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [17:39:34][14936][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [17:39:34][14936][ERROR] Demodulation failed (error: 1006)! [17:39:34][14936][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [17:54:36][10676][INFO ] Starting data processing... [17:54:37][10676][INFO ] CUDA device ID: 0 [17:54:37][10676][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [17:54:37][10676][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [17:54:37][10676][INFO ] Version of installed CUDA driver: 9010 [17:54:37][10676][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [17:55:17][1816][INFO ] Starting data processing... [17:55:17][1816][INFO ] CUDA device ID: 0 [17:55:17][1816][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [17:55:17][1816][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [17:55:17][1816][INFO ] Version of installed CUDA driver: 9010 [17:55:17][1816][INFO ] Version of CUDA driver API used: 3020 [17:55:51][1816][INFO ] Number of generated templates to be used: 50000 [17:55:51][1816][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [17:55:51][1816][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [17:55:51][1816][INFO ] Seed for random number generator is -1046983535. [17:55:56][1816][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [17:55:56][1816][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [17:55:56][1816][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [17:55:56][1816][ERROR] Demodulation failed (error: 1006)! [17:55:56][1816][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [18:24:03][4380][INFO ] Starting data processing... [18:24:03][4380][INFO ] CUDA device ID: 0 [18:24:03][4380][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [18:24:03][4380][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [18:24:03][4380][INFO ] Version of installed CUDA driver: 9010 [18:24:03][4380][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [18:26:23][1172][INFO ] Starting data processing... [18:26:23][1172][INFO ] CUDA device ID: 0 [18:26:23][1172][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [18:26:23][1172][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [18:26:23][1172][INFO ] Version of installed CUDA driver: 9010 [18:26:23][1172][INFO ] Version of CUDA driver API used: 3020 [18:26:37][1172][INFO ] Number of generated templates to be used: 50000 [18:26:37][1172][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [18:26:37][1172][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [18:26:37][1172][INFO ] Seed for random number generator is -1046983535. [18:26:42][1172][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [18:26:42][1172][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [18:26:42][1172][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [18:26:42][1172][ERROR] Demodulation failed (error: 1006)! [18:26:42][1172][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [18:41:53][5228][INFO ] Starting data processing... [18:41:54][5228][INFO ] CUDA device ID: 0 [18:41:54][5228][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [18:41:54][5228][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [18:41:54][5228][INFO ] Version of installed CUDA driver: 9010 [18:41:54][5228][INFO ] Version of CUDA driver API used: 3020 [18:42:07][5228][INFO ] Number of generated templates to be used: 50000 [18:42:07][5228][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [18:42:07][5228][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [18:42:07][5228][INFO ] Seed for random number generator is -1046983535. [18:42:12][5228][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [18:42:12][5228][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [18:42:12][5228][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [18:42:12][5228][ERROR] Demodulation failed (error: 1006)! [18:42:12][5228][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [18:57:22][14460][INFO ] Starting data processing... [18:57:22][14460][INFO ] CUDA device ID: 0 [18:57:22][14460][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [18:57:22][14460][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [18:57:22][14460][INFO ] Version of installed CUDA driver: 9010 [18:57:22][14460][INFO ] Version of CUDA driver API used: 3020 [18:57:36][14460][INFO ] Number of generated templates to be used: 50000 [18:57:36][14460][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [18:57:36][14460][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [18:57:36][14460][INFO ] Seed for random number generator is -1046983535. [18:57:41][14460][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [18:57:41][14460][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [18:57:41][14460][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [18:57:41][14460][ERROR] Demodulation failed (error: 1006)! [18:57:41][14460][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [19:12:51][7700][INFO ] Starting data processing... [19:12:51][7700][INFO ] CUDA device ID: 0 [19:12:51][7700][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:12:51][7700][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:12:51][7700][INFO ] Version of installed CUDA driver: 9010 [19:12:51][7700][INFO ] Version of CUDA driver API used: 3020 [19:13:05][7700][INFO ] Number of generated templates to be used: 50000 [19:13:05][7700][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [19:13:05][7700][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [19:13:05][7700][INFO ] Seed for random number generator is -1046983535. [19:13:10][7700][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [19:13:10][7700][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [19:13:10][7700][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [19:13:10][7700][ERROR] Demodulation failed (error: 1006)! [19:13:10][7700][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [19:28:30][14852][INFO ] Starting data processing... [19:28:30][14852][INFO ] CUDA device ID: 0 [19:28:30][14852][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:28:30][14852][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:28:30][14852][INFO ] Version of installed CUDA driver: 9010 [19:28:30][14852][INFO ] Version of CUDA driver API used: 3020 [19:28:44][14852][INFO ] Number of generated templates to be used: 50000 [19:28:44][14852][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [19:28:44][14852][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [19:28:44][14852][INFO ] Seed for random number generator is -1046983535. [19:28:49][14852][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [19:28:49][14852][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [19:28:49][14852][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [19:28:49][14852][ERROR] Demodulation failed (error: 1006)! [19:28:49][14852][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [19:48:11][7952][INFO ] Starting data processing... [19:48:12][7952][INFO ] CUDA device ID: 0 [19:48:12][7952][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:48:12][7952][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:48:12][7952][INFO ] Version of installed CUDA driver: 9010 [19:48:12][7952][INFO ] Version of CUDA driver API used: 3020 [19:48:25][7952][INFO ] Number of generated templates to be used: 50000 [19:48:25][7952][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [19:48:25][7952][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [19:48:25][7952][INFO ] Seed for random number generator is -1046983535. [19:48:30][7952][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [19:48:30][7952][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [19:48:30][7952][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [19:48:30][7952][ERROR] Demodulation failed (error: 1006)! [19:48:30][7952][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [19:53:41][13216][INFO ] Starting data processing... [19:53:41][13216][INFO ] CUDA device ID: 0 [19:53:41][13216][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:53:41][13216][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:53:41][13216][INFO ] Version of installed CUDA driver: 9010 [19:53:41][13216][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [20:03:57][12052][INFO ] Starting data processing... [20:03:57][12052][INFO ] CUDA device ID: 0 [20:03:57][12052][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [20:03:57][12052][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [20:03:57][12052][INFO ] Version of installed CUDA driver: 9010 [20:03:57][12052][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [20:04:39][13572][INFO ] Starting data processing... [20:04:40][13572][INFO ] CUDA device ID: 0 [20:04:40][13572][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [20:04:40][13572][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [20:04:40][13572][INFO ] Version of installed CUDA driver: 9010 [20:04:40][13572][INFO ] Version of CUDA driver API used: 3020 [20:05:14][13572][INFO ] Number of generated templates to be used: 50000 [20:05:14][13572][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [20:05:14][13572][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [20:05:14][13572][INFO ] Seed for random number generator is -1046983535. [20:05:19][13572][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [20:05:19][13572][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [20:05:19][13572][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [20:05:19][13572][ERROR] Demodulation failed (error: 1006)! [20:05:19][13572][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [20:31:04][14068][INFO ] Starting data processing... [20:31:05][14068][INFO ] CUDA device ID: 0 [20:31:05][14068][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [20:31:05][14068][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [20:31:05][14068][INFO ] Version of installed CUDA driver: 9010 [20:31:05][14068][INFO ] Version of CUDA driver API used: 3020 [20:31:18][14068][INFO ] Number of generated templates to be used: 50000 [20:31:18][14068][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [20:31:18][14068][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [20:31:18][14068][INFO ] Seed for random number generator is -1046983535. [20:31:23][14068][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [20:31:23][14068][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [20:31:23][14068][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [20:31:23][14068][ERROR] Demodulation failed (error: 1006)! [20:31:23][14068][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [20:37:17][13184][INFO ] Starting data processing... [20:37:17][13184][INFO ] CUDA device ID: 0 [20:37:17][13184][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [20:37:17][13184][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [20:37:17][13184][INFO ] Version of installed CUDA driver: 9010 [20:37:17][13184][INFO ] Version of CUDA driver API used: 3020 [20:37:31][13184][INFO ] Number of generated templates to be used: 50000 [20:37:31][13184][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [20:37:31][13184][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [20:37:31][13184][INFO ] Seed for random number generator is -1046983535. [20:37:35][13184][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [20:37:35][13184][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [20:37:36][13184][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [20:37:36][13184][ERROR] Demodulation failed (error: 1006)! [20:37:36][13184][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [20:37:56][11816][INFO ] Starting data processing... [20:37:56][11816][INFO ] CUDA device ID: 0 [20:37:56][11816][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [20:37:56][11816][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [20:37:56][11816][INFO ] Version of installed CUDA driver: 9010 [20:37:56][11816][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [01:20:13][5668][INFO ] Starting data processing... [01:20:14][5668][INFO ] CUDA device ID: 0 [01:20:14][5668][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [01:20:14][5668][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [01:20:14][5668][INFO ] Version of installed CUDA driver: 9010 [01:20:14][5668][INFO ] Version of CUDA driver API used: 3020 [01:20:47][5668][INFO ] Number of generated templates to be used: 50000 [01:20:47][5668][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [01:20:47][5668][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [01:20:47][5668][INFO ] Seed for random number generator is -1046983535. [01:20:52][5668][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [01:20:52][5668][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 970 MB (55 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 785 MB [01:20:56][5668][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [01:20:56][5668][ERROR] Demodulation failed (error: 1006)! [01:20:56][5668][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [01:36:05][13940][INFO ] Starting data processing... [01:36:05][13940][INFO ] CUDA device ID: 0 [01:36:05][13940][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [01:36:05][13940][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [01:36:05][13940][INFO ] Version of installed CUDA driver: 9010 [01:36:05][13940][INFO ] Version of CUDA driver API used: 3020 [01:36:38][13940][INFO ] Number of generated templates to be used: 50000 [01:36:38][13940][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [01:36:38][13940][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [01:36:38][13940][INFO ] Seed for random number generator is -1046983535. [01:36:43][13940][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [01:36:43][13940][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 988 MB (37 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 803 MB [01:36:44][13940][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [01:36:44][13940][ERROR] Demodulation failed (error: 1006)! [01:36:44][13940][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... </stderr_txt> ]]>
Language
Copyright © 2024 Einstein@Home. All rights reserved.