Task 1718660381
|
Ter5_1_dns_cfbf00113_segment_1_dms_200_40000_171_5900000_1
23 Jan 2025 4:33:37 UTC
23 Jan 2025 23:33:02 UTC
6 Feb 2025 23:33:02 UTC
1 Feb 2025 1:21:33 UTC
Over
Computation error
Compute error
-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
18.19
18.13
381.8
765.91
75.66
Invalid
0
Binary Radio Pulsar Search (MeerKAT) v0.12 (BRP7-cuda55)
windows_x86_64 |
Stderr output
<core_client_version>8.0.2</core_client_version> <![CDATA[ <message> too many boinc_temporary_exit()s</message> <stderr_txt> 00" (192 CUDA cores / 336.19 GFLOPS) [14:44:13][7112][INFO ] Version of installed CUDA driver: 9010 [14:44:13][7112][INFO ] Version of CUDA driver API used: 3020 [14:44:26][7112][INFO ] Number of generated templates to be used: 50000 [14:44:26][7112][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [14:44:26][7112][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [14:44:27][7112][INFO ] Seed for random number generator is -1046983535. [14:44:31][7112][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [14:44:31][7112][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [14:44:32][7112][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [14:44:32][7112][ERROR] Demodulation failed (error: 1006)! [14:44:32][7112][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [14:59:38][1108][INFO ] Starting data processing... [14:59:38][1108][INFO ] CUDA device ID: 0 [14:59:38][1108][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [14:59:38][1108][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [14:59:38][1108][INFO ] Version of installed CUDA driver: 9010 [14:59:38][1108][INFO ] Version of CUDA driver API used: 3020 [15:00:12][1108][INFO ] Number of generated templates to be used: 50000 [15:00:12][1108][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [15:00:12][1108][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [15:00:12][1108][INFO ] Seed for random number generator is -1046983535. [15:00:17][1108][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [15:00:17][1108][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [15:00:17][1108][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [15:00:17][1108][ERROR] Demodulation failed (error: 1006)! [15:00:17][1108][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [15:15:18][11240][INFO ] Starting data processing... [15:15:19][11240][INFO ] CUDA device ID: 0 [15:15:19][11240][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [15:15:19][11240][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [15:15:19][11240][INFO ] Version of installed CUDA driver: 9010 [15:15:19][11240][INFO ] Version of CUDA driver API used: 3020 [15:15:53][11240][INFO ] Number of generated templates to be used: 50000 [15:15:53][11240][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [15:15:53][11240][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [15:15:53][11240][INFO ] Seed for random number generator is -1046983535. [15:15:58][11240][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [15:15:58][11240][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [15:15:58][11240][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [15:15:58][11240][ERROR] Demodulation failed (error: 1006)! [15:15:58][11240][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [15:16:19][5596][INFO ] Starting data processing... [15:16:19][5596][INFO ] CUDA device ID: 0 [15:16:19][5596][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [15:16:19][5596][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [15:16:19][5596][INFO ] Version of installed CUDA driver: 9010 [15:16:19][5596][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [15:31:05][14444][INFO ] Starting data processing... [15:31:05][14444][INFO ] CUDA device ID: 0 [15:31:05][14444][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [15:31:05][14444][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [15:31:05][14444][INFO ] Version of installed CUDA driver: 9010 [15:31:05][14444][INFO ] Version of CUDA driver API used: 3020 [15:31:39][14444][INFO ] Number of generated templates to be used: 50000 [15:31:39][14444][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [15:31:39][14444][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [15:31:39][14444][INFO ] Seed for random number generator is -1046983535. [15:31:44][14444][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [15:31:44][14444][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [15:31:44][14444][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [15:31:44][14444][ERROR] Demodulation failed (error: 1006)! [15:31:44][14444][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [15:46:48][8520][INFO ] Starting data processing... [15:46:48][8520][INFO ] CUDA device ID: 0 [15:46:48][8520][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [15:46:48][8520][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [15:46:48][8520][INFO ] Version of installed CUDA driver: 9010 [15:46:48][8520][INFO ] Version of CUDA driver API used: 3020 [15:47:21][8520][INFO ] Number of generated templates to be used: 50000 [15:47:21][8520][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [15:47:22][8520][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [15:47:22][8520][INFO ] Seed for random number generator is -1046983535. [15:47:26][8520][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [15:47:26][8520][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [15:47:27][8520][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [15:47:27][8520][ERROR] Demodulation failed (error: 1006)! [15:47:27][8520][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [16:02:35][15324][INFO ] Starting data processing... [16:02:35][15324][INFO ] CUDA device ID: 0 [16:02:36][15324][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [16:02:36][15324][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [16:02:36][15324][INFO ] Version of installed CUDA driver: 9010 [16:02:36][15324][INFO ] Version of CUDA driver API used: 3020 [16:03:09][15324][INFO ] Number of generated templates to be used: 50000 [16:03:09][15324][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [16:03:09][15324][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [16:03:09][15324][INFO ] Seed for random number generator is -1046983535. [16:03:14][15324][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [16:03:14][15324][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [16:03:14][15324][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [16:03:14][15324][ERROR] Demodulation failed (error: 1006)! [16:03:14][15324][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [16:03:35][4500][INFO ] Starting data processing... [16:03:35][4500][INFO ] CUDA device ID: 0 [16:03:35][4500][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [16:03:35][4500][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [16:03:35][4500][INFO ] Version of installed CUDA driver: 9010 [16:03:35][4500][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [16:18:15][14488][INFO ] Starting data processing... [16:18:15][14488][INFO ] CUDA device ID: 0 [16:18:15][14488][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [16:18:15][14488][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [16:18:15][14488][INFO ] Version of installed CUDA driver: 9010 [16:18:15][14488][INFO ] Version of CUDA driver API used: 3020 [16:18:49][14488][INFO ] Number of generated templates to be used: 50000 [16:18:49][14488][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [16:18:49][14488][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [16:18:49][14488][INFO ] Seed for random number generator is -1046983535. [16:18:54][14488][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [16:18:54][14488][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [16:18:54][14488][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [16:18:54][14488][ERROR] Demodulation failed (error: 1006)! [16:18:54][14488][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [16:34:00][14936][INFO ] Starting data processing... [16:34:00][14936][INFO ] CUDA device ID: 0 [16:34:00][14936][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [16:34:00][14936][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [16:34:00][14936][INFO ] Version of installed CUDA driver: 9010 [16:34:00][14936][INFO ] Version of CUDA driver API used: 3020 [16:34:34][14936][INFO ] Number of generated templates to be used: 50000 [16:34:34][14936][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [16:34:34][14936][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [16:34:34][14936][INFO ] Seed for random number generator is -1046983535. [16:34:39][14936][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [16:34:39][14936][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [16:34:39][14936][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [16:34:39][14936][ERROR] Demodulation failed (error: 1006)! [16:34:39][14936][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [16:49:45][1380][INFO ] Starting data processing... [16:49:46][1380][INFO ] CUDA device ID: 0 [16:49:46][1380][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [16:49:46][1380][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [16:49:46][1380][INFO ] Version of installed CUDA driver: 9010 [16:49:46][1380][INFO ] Version of CUDA driver API used: 3020 [16:50:19][1380][INFO ] Number of generated templates to be used: 50000 [16:50:19][1380][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [16:50:19][1380][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [16:50:20][1380][INFO ] Seed for random number generator is -1046983535. [16:50:24][1380][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [16:50:24][1380][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [16:50:25][1380][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [16:50:25][1380][ERROR] Demodulation failed (error: 1006)! [16:50:25][1380][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [17:05:29][15300][INFO ] Starting data processing... [17:05:29][15300][INFO ] CUDA device ID: 0 [17:05:29][15300][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [17:05:29][15300][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [17:05:29][15300][INFO ] Version of installed CUDA driver: 9010 [17:05:29][15300][INFO ] Version of CUDA driver API used: 3020 [17:06:03][15300][INFO ] Number of generated templates to be used: 50000 [17:06:03][15300][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [17:06:03][15300][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [17:06:03][15300][INFO ] Seed for random number generator is -1046983535. [17:06:08][15300][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [17:06:08][15300][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [17:06:08][15300][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [17:06:08][15300][ERROR] Demodulation failed (error: 1006)! [17:06:08][15300][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [17:21:13][8320][INFO ] Starting data processing... [17:21:13][8320][INFO ] CUDA device ID: 0 [17:21:13][8320][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [17:21:13][8320][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [17:21:13][8320][INFO ] Version of installed CUDA driver: 9010 [17:21:13][8320][INFO ] Version of CUDA driver API used: 3020 [17:21:47][8320][INFO ] Number of generated templates to be used: 50000 [17:21:47][8320][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [17:21:47][8320][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [17:21:47][8320][INFO ] Seed for random number generator is -1046983535. [17:21:52][8320][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [17:21:52][8320][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [17:21:52][8320][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [17:21:52][8320][ERROR] Demodulation failed (error: 1006)! [17:21:52][8320][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [17:36:57][4612][INFO ] Starting data processing... [17:36:57][4612][INFO ] CUDA device ID: 0 [17:36:57][4612][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [17:36:57][4612][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [17:36:57][4612][INFO ] Version of installed CUDA driver: 9010 [17:36:57][4612][INFO ] Version of CUDA driver API used: 3020 [17:37:31][4612][INFO ] Number of generated templates to be used: 50000 [17:37:31][4612][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [17:37:31][4612][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [17:37:31][4612][INFO ] Seed for random number generator is -1046983535. [17:37:36][4612][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [17:37:36][4612][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [17:37:36][4612][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [17:37:36][4612][ERROR] Demodulation failed (error: 1006)! [17:37:36][4612][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [17:52:59][8112][INFO ] Starting data processing... [17:52:59][8112][INFO ] CUDA device ID: 0 [17:52:59][8112][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [17:52:59][8112][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [17:52:59][8112][INFO ] Version of installed CUDA driver: 9010 [17:52:59][8112][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [17:53:46][8624][INFO ] Starting data processing... [17:53:46][8624][INFO ] CUDA device ID: 0 [17:53:46][8624][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [17:53:46][8624][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [17:53:46][8624][INFO ] Version of installed CUDA driver: 9010 [17:53:46][8624][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [17:54:38][15204][INFO ] Starting data processing... [17:54:38][15204][INFO ] CUDA device ID: 0 [17:54:38][15204][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [17:54:38][15204][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [17:54:38][15204][INFO ] Version of installed CUDA driver: 9010 [17:54:38][15204][INFO ] Version of CUDA driver API used: 3020 [17:55:11][15204][INFO ] Number of generated templates to be used: 50000 [17:55:11][15204][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [17:55:11][15204][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [17:55:12][15204][INFO ] Seed for random number generator is -1046983535. [17:55:16][15204][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [17:55:16][15204][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [17:55:16][15204][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [17:55:16][15204][ERROR] Demodulation failed (error: 1006)! [17:55:16][15204][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [18:24:34][7672][INFO ] Starting data processing... [18:24:34][7672][INFO ] CUDA device ID: 0 [18:24:34][7672][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [18:24:34][7672][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [18:24:34][7672][INFO ] Version of installed CUDA driver: 9010 [18:24:34][7672][INFO ] Version of CUDA driver API used: 3020 [18:24:48][7672][INFO ] Number of generated templates to be used: 50000 [18:24:48][7672][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [18:24:48][7672][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [18:24:48][7672][INFO ] Seed for random number generator is -1046983535. [18:24:52][7672][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [18:24:53][7672][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [18:24:53][7672][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [18:24:53][7672][ERROR] Demodulation failed (error: 1006)! [18:24:53][7672][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [18:40:12][14248][INFO ] Starting data processing... [18:40:12][14248][INFO ] CUDA device ID: 0 [18:40:13][14248][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [18:40:13][14248][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [18:40:13][14248][INFO ] Version of installed CUDA driver: 9010 [18:40:13][14248][INFO ] Version of CUDA driver API used: 3020 [18:40:26][14248][INFO ] Number of generated templates to be used: 50000 [18:40:26][14248][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [18:40:26][14248][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [18:40:26][14248][INFO ] Seed for random number generator is -1046983535. [18:40:31][14248][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [18:40:31][14248][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [18:40:31][14248][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [18:40:31][14248][ERROR] Demodulation failed (error: 1006)! [18:40:31][14248][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [18:55:41][14800][INFO ] Starting data processing... [18:55:41][14800][INFO ] CUDA device ID: 0 [18:55:41][14800][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [18:55:41][14800][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [18:55:41][14800][INFO ] Version of installed CUDA driver: 9010 [18:55:41][14800][INFO ] Version of CUDA driver API used: 3020 [18:55:54][14800][INFO ] Number of generated templates to be used: 50000 [18:55:54][14800][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [18:55:54][14800][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [18:55:55][14800][INFO ] Seed for random number generator is -1046983535. [18:55:59][14800][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [18:55:59][14800][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [18:55:59][14800][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [18:55:59][14800][ERROR] Demodulation failed (error: 1006)! [18:55:59][14800][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [19:11:10][6712][INFO ] Starting data processing... [19:11:10][6712][INFO ] CUDA device ID: 0 [19:11:10][6712][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:11:10][6712][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:11:10][6712][INFO ] Version of installed CUDA driver: 9010 [19:11:10][6712][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [19:11:33][11332][INFO ] Starting data processing... [19:11:33][11332][INFO ] CUDA device ID: 0 [19:11:33][11332][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:11:33][11332][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:11:33][11332][INFO ] Version of installed CUDA driver: 9010 [19:11:33][11332][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [19:12:19][12628][INFO ] Starting data processing... [19:12:20][12628][INFO ] CUDA device ID: 0 [19:12:20][12628][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:12:20][12628][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:12:20][12628][INFO ] Version of installed CUDA driver: 9010 [19:12:20][12628][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [19:13:10][14320][INFO ] Starting data processing... [19:13:10][14320][INFO ] CUDA device ID: 0 [19:13:10][14320][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:13:10][14320][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:13:10][14320][INFO ] Version of installed CUDA driver: 9010 [19:13:10][14320][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [19:14:00][7332][INFO ] Starting data processing... [19:14:01][7332][INFO ] CUDA device ID: 0 [19:14:01][7332][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:14:01][7332][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:14:01][7332][INFO ] Version of installed CUDA driver: 9010 [19:14:01][7332][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [19:14:51][13008][INFO ] Starting data processing... [19:14:51][13008][INFO ] CUDA device ID: 0 [19:14:51][13008][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:14:51][13008][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:14:51][13008][INFO ] Version of installed CUDA driver: 9010 [19:14:51][13008][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [19:15:41][952][INFO ] Starting data processing... [19:15:42][952][INFO ] CUDA device ID: 0 [19:15:42][952][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:15:42][952][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:15:42][952][INFO ] Version of installed CUDA driver: 9010 [19:15:42][952][INFO ] Version of CUDA driver API used: 3020 [19:16:15][952][INFO ] Number of generated templates to be used: 50000 [19:16:15][952][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [19:16:15][952][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [19:16:16][952][INFO ] Seed for random number generator is -1046983535. [19:16:20][952][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [19:16:20][952][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [19:16:20][952][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [19:16:21][952][ERROR] Demodulation failed (error: 1006)! [19:16:21][952][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [19:31:26][10832][INFO ] Starting data processing... [19:31:26][10832][INFO ] CUDA device ID: 0 [19:31:26][10832][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:31:26][10832][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:31:26][10832][INFO ] Version of installed CUDA driver: 9010 [19:31:26][10832][INFO ] Version of CUDA driver API used: 3020 [19:32:00][10832][INFO ] Number of generated templates to be used: 50000 [19:32:00][10832][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [19:32:00][10832][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [19:32:00][10832][INFO ] Seed for random number generator is -1046983535. [19:32:05][10832][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [19:32:05][10832][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [19:32:05][10832][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [19:32:05][10832][ERROR] Demodulation failed (error: 1006)! [19:32:05][10832][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [19:46:30][4568][INFO ] Starting data processing... [19:46:31][4568][INFO ] CUDA device ID: 0 [19:46:31][4568][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:46:31][4568][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:46:31][4568][INFO ] Version of installed CUDA driver: 9010 [19:46:31][4568][INFO ] Version of CUDA driver API used: 3020 [19:46:44][4568][INFO ] Number of generated templates to be used: 50000 [19:46:44][4568][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [19:46:44][4568][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [19:46:44][4568][INFO ] Seed for random number generator is -1046983535. [19:46:49][4568][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [19:46:49][4568][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [19:46:49][4568][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [19:46:49][4568][ERROR] Demodulation failed (error: 1006)! [19:46:49][4568][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [19:54:25][12508][INFO ] Starting data processing... [19:54:25][12508][INFO ] CUDA device ID: 0 [19:54:25][12508][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:54:25][12508][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:54:25][12508][INFO ] Version of installed CUDA driver: 9010 [19:54:25][12508][INFO ] Version of CUDA driver API used: 3020 Activated exception handling... [20:03:18][8068][INFO ] Starting data processing... [20:03:18][8068][INFO ] CUDA device ID: 0 [20:03:18][8068][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [20:03:18][8068][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [20:03:18][8068][INFO ] Version of installed CUDA driver: 9010 [20:03:18][8068][INFO ] Version of CUDA driver API used: 3020 [20:03:52][8068][INFO ] Number of generated templates to be used: 50000 [20:03:52][8068][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [20:03:52][8068][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [20:03:52][8068][INFO ] Seed for random number generator is -1046983535. [20:03:57][8068][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [20:03:57][8068][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [20:03:57][8068][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [20:03:57][8068][ERROR] Demodulation failed (error: 1006)! [20:03:57][8068][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [20:18:59][15344][INFO ] Starting data processing... [20:18:59][15344][INFO ] CUDA device ID: 0 [20:18:59][15344][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [20:18:59][15344][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [20:18:59][15344][INFO ] Version of installed CUDA driver: 9010 [20:18:59][15344][INFO ] Version of CUDA driver API used: 3020 [20:19:33][15344][INFO ] Number of generated templates to be used: 50000 [20:19:33][15344][INFO ] Checkpoint file unavailable: Ter5_1_dns_cfbf00113_segment_1_dms_200_171.cpt (No error). ------> Starting from scratch... [20:19:33][15344][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00113/Ter5_1_dns_cfbf00113_segment_1_dms_200_DM247.10 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673401017353 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174804.33 ------> DEC (J2000): -244749.700001 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 247.1 cm^-3 pc ------> Scale factor: 1.10309 [20:19:33][15344][INFO ] Seed for random number generator is -1046983535. [20:19:38][15344][INFO ] Derived global search parameters: ------> f_A probability = 0.04 ------> single bin prob(P_noise > P_thr) = 3.24424e-009 ------> thr1 = 19.5464 ------> thr2 = 22.7124 ------> thr4 = 27.844 ------> thr8 = 36.3869 ------> thr16 = 50.9469 [20:19:38][15344][INFO ] CUDA global memory status (GPU setup complete): ------> Used in total: 1025 MB (0 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 840 MB [20:19:38][15344][ERROR] Couldn't allocate 37640 bytes of CUDA HS summing memory (error: 2)! [20:19:38][15344][ERROR] Demodulation failed (error: 1006)! [20:19:38][15344][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... </stderr_txt> ]]>
Language
Copyright © 2024 Einstein@Home. All rights reserved.