Task 1712147683
|
Ter5_1_dns_cfbf00111_segment_1_dms_200_40000_48_3800000_1
10 Jan 2025 22:44:22 UTC
10 Jan 2025 23:12:19 UTC
24 Jan 2025 23:12:19 UTC
22 Jan 2025 7:46:32 UTC
Over
Computation error
Compute error
-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
61.13
37.86
381.04
766.49
75.82
Invalid
0
Binary Radio Pulsar Search (MeerKAT) v0.12 (BRP7-cuda55)
windows_x86_64 |
Stderr output
<core_client_version>8.0.2</core_client_version> <![CDATA[ <message> too many boinc_temporary_exit()s</message> <stderr_txt> 55 [19:25:06][17264][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [19:25:06][17264][INFO ] Seed for random number generator is -1038395420. [19:25:10][17264][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [19:25:11][17264][ERROR] Demodulation failed (error: 1006)! [19:25:11][17264][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [19:40:12][17404][INFO ] Starting data processing... [19:40:12][17404][INFO ] CUDA device ID: 0 [19:40:12][17404][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:40:12][17404][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:40:12][17404][INFO ] Version of installed CUDA driver: 9010 [19:40:12][17404][INFO ] Version of CUDA driver API used: 3020 [19:40:47][17404][INFO ] Number of generated templates to be used: 50000 [19:40:47][17404][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [19:40:47][17404][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [19:40:47][17404][INFO ] Seed for random number generator is -1038395420. [19:40:52][17404][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [19:40:52][17404][ERROR] Demodulation failed (error: 1006)! [19:40:52][17404][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [19:55:54][18812][INFO ] Starting data processing... [19:55:54][18812][INFO ] CUDA device ID: 0 [19:55:54][18812][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [19:55:54][18812][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [19:55:54][18812][INFO ] Version of installed CUDA driver: 9010 [19:55:54][18812][INFO ] Version of CUDA driver API used: 3020 [19:56:29][18812][INFO ] Number of generated templates to be used: 50000 [19:56:29][18812][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [19:56:29][18812][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [19:56:29][18812][INFO ] Seed for random number generator is -1038395420. [19:56:33][18812][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [19:56:33][18812][ERROR] Demodulation failed (error: 1006)! [19:56:33][18812][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [20:11:36][9764][INFO ] Starting data processing... [20:11:36][9764][INFO ] CUDA device ID: 0 [20:11:36][9764][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [20:11:36][9764][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [20:11:36][9764][INFO ] Version of installed CUDA driver: 9010 [20:11:36][9764][INFO ] Version of CUDA driver API used: 3020 [20:12:10][9764][INFO ] Number of generated templates to be used: 50000 [20:12:10][9764][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [20:12:10][9764][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [20:12:11][9764][INFO ] Seed for random number generator is -1038395420. [20:12:15][9764][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [20:12:15][9764][ERROR] Demodulation failed (error: 1006)! [20:12:15][9764][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [20:27:19][17388][INFO ] Starting data processing... [20:27:19][17388][INFO ] CUDA device ID: 0 [20:27:19][17388][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [20:27:19][17388][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [20:27:19][17388][INFO ] Version of installed CUDA driver: 9010 [20:27:19][17388][INFO ] Version of CUDA driver API used: 3020 [20:27:53][17388][INFO ] Number of generated templates to be used: 50000 [20:27:53][17388][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [20:27:53][17388][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [20:27:53][17388][INFO ] Seed for random number generator is -1038395420. [20:27:58][17388][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [20:27:58][17388][ERROR] Demodulation failed (error: 1006)! [20:27:58][17388][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [20:43:01][19348][INFO ] Starting data processing... [20:43:01][19348][INFO ] CUDA device ID: 0 [20:43:01][19348][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [20:43:01][19348][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [20:43:01][19348][INFO ] Version of installed CUDA driver: 9010 [20:43:01][19348][INFO ] Version of CUDA driver API used: 3020 [20:43:35][19348][INFO ] Number of generated templates to be used: 50000 [20:43:35][19348][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [20:43:35][19348][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [20:43:35][19348][INFO ] Seed for random number generator is -1038395420. [20:43:40][19348][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [20:43:40][19348][ERROR] Demodulation failed (error: 1006)! [20:43:40][19348][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [20:58:43][18120][INFO ] Starting data processing... [20:58:43][18120][INFO ] CUDA device ID: 0 [20:58:43][18120][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [20:58:43][18120][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [20:58:43][18120][INFO ] Version of installed CUDA driver: 9010 [20:58:43][18120][INFO ] Version of CUDA driver API used: 3020 [20:59:17][18120][INFO ] Number of generated templates to be used: 50000 [20:59:17][18120][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [20:59:17][18120][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [20:59:17][18120][INFO ] Seed for random number generator is -1038395420. [20:59:22][18120][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [20:59:22][18120][ERROR] Demodulation failed (error: 1006)! [20:59:22][18120][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [21:14:25][2936][INFO ] Starting data processing... [21:14:25][2936][INFO ] CUDA device ID: 0 [21:14:25][2936][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [21:14:25][2936][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [21:14:25][2936][INFO ] Version of installed CUDA driver: 9010 [21:14:25][2936][INFO ] Version of CUDA driver API used: 3020 [21:14:59][2936][INFO ] Number of generated templates to be used: 50000 [21:14:59][2936][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [21:14:59][2936][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [21:14:59][2936][INFO ] Seed for random number generator is -1038395420. [21:15:04][2936][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [21:15:04][2936][ERROR] Demodulation failed (error: 1006)! [21:15:04][2936][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [21:30:07][14788][INFO ] Starting data processing... [21:30:07][14788][INFO ] CUDA device ID: 0 [21:30:07][14788][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [21:30:07][14788][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [21:30:07][14788][INFO ] Version of installed CUDA driver: 9010 [21:30:07][14788][INFO ] Version of CUDA driver API used: 3020 [21:30:41][14788][INFO ] Number of generated templates to be used: 50000 [21:30:41][14788][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [21:30:41][14788][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [21:30:41][14788][INFO ] Seed for random number generator is -1038395420. [21:30:46][14788][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [21:30:46][14788][ERROR] Demodulation failed (error: 1006)! [21:30:46][14788][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [21:45:48][21220][INFO ] Starting data processing... [21:45:49][21220][INFO ] CUDA device ID: 0 [21:45:49][21220][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [21:45:49][21220][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [21:45:49][21220][INFO ] Version of installed CUDA driver: 9010 [21:45:49][21220][INFO ] Version of CUDA driver API used: 3020 [21:46:23][21220][INFO ] Number of generated templates to be used: 50000 [21:46:23][21220][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [21:46:23][21220][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [21:46:23][21220][INFO ] Seed for random number generator is -1038395420. [21:46:28][21220][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [21:46:28][21220][ERROR] Demodulation failed (error: 1006)! [21:46:28][21220][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [22:01:49][7228][INFO ] Starting data processing... [22:01:50][7228][INFO ] CUDA device ID: 0 [22:01:50][7228][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [22:01:50][7228][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [22:01:50][7228][INFO ] Version of installed CUDA driver: 9010 [22:01:50][7228][INFO ] Version of CUDA driver API used: 3020 [22:02:23][7228][INFO ] Number of generated templates to be used: 50000 [22:02:23][7228][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [22:02:24][7228][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [22:02:24][7228][INFO ] Seed for random number generator is -1038395420. [22:02:28][7228][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [22:02:28][7228][ERROR] Demodulation failed (error: 1006)! [22:02:28][7228][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [22:09:50][12856][INFO ] Starting data processing... [22:09:51][12856][INFO ] CUDA device ID: 0 [22:09:51][12856][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [22:09:51][12856][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [22:09:51][12856][INFO ] Version of installed CUDA driver: 9010 [22:09:51][12856][INFO ] Version of CUDA driver API used: 3020 [22:10:24][12856][INFO ] Number of generated templates to be used: 50000 [22:10:24][12856][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [22:10:24][12856][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [22:10:25][12856][INFO ] Seed for random number generator is -1038395420. [22:10:29][12856][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [22:10:29][12856][ERROR] Demodulation failed (error: 1006)! [22:10:29][12856][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [22:25:32][11012][INFO ] Starting data processing... [22:25:32][11012][INFO ] CUDA device ID: 0 [22:25:32][11012][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [22:25:32][11012][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [22:25:32][11012][INFO ] Version of installed CUDA driver: 9010 [22:25:32][11012][INFO ] Version of CUDA driver API used: 3020 [22:26:06][11012][INFO ] Number of generated templates to be used: 50000 [22:26:06][11012][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [22:26:06][11012][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [22:26:07][11012][INFO ] Seed for random number generator is -1038395420. [22:26:11][11012][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [22:26:11][11012][ERROR] Demodulation failed (error: 1006)! [22:26:11][11012][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [22:41:16][16816][INFO ] Starting data processing... [22:41:16][16816][INFO ] CUDA device ID: 0 [22:41:16][16816][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [22:41:16][16816][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [22:41:16][16816][INFO ] Version of installed CUDA driver: 9010 [22:41:16][16816][INFO ] Version of CUDA driver API used: 3020 [22:41:50][16816][INFO ] Number of generated templates to be used: 50000 [22:41:50][16816][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [22:41:50][16816][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [22:41:50][16816][INFO ] Seed for random number generator is -1038395420. [22:41:55][16816][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [22:41:55][16816][ERROR] Demodulation failed (error: 1006)! [22:41:55][16816][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [23:06:18][20660][INFO ] Starting data processing... [23:06:18][20660][INFO ] CUDA device ID: 0 [23:06:18][20660][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [23:06:18][20660][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [23:06:18][20660][INFO ] Version of installed CUDA driver: 9010 [23:06:18][20660][INFO ] Version of CUDA driver API used: 3020 [23:06:53][20660][INFO ] Number of generated templates to be used: 50000 [23:06:53][20660][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [23:06:53][20660][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [23:06:53][20660][INFO ] Seed for random number generator is -1038395420. [23:06:58][20660][ERROR] Error allocating power spectrum device memory: 50332672 bytes (error: 2) [23:06:58][20660][ERROR] Demodulation failed (error: 1006)! [23:06:58][20660][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [23:31:52][9624][INFO ] Starting data processing... [23:31:52][9624][INFO ] CUDA device ID: 0 [23:31:52][9624][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [23:31:52][9624][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [23:31:52][9624][INFO ] Version of installed CUDA driver: 9010 [23:31:52][9624][INFO ] Version of CUDA driver API used: 3020 [23:32:26][9624][INFO ] Number of generated templates to be used: 50000 [23:32:26][9624][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [23:32:26][9624][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [23:32:26][9624][INFO ] Seed for random number generator is -1038395420. [23:32:31][9624][ERROR] Error allocating power spectrum device memory: 50332672 bytes (error: 2) [23:32:31][9624][ERROR] Demodulation failed (error: 1006)! [23:32:31][9624][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [23:47:32][9124][INFO ] Starting data processing... [23:47:33][9124][INFO ] CUDA device ID: 0 [23:47:33][9124][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [23:47:33][9124][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [23:47:33][9124][INFO ] Version of installed CUDA driver: 9010 [23:47:33][9124][INFO ] Version of CUDA driver API used: 3020 [23:48:07][9124][INFO ] Number of generated templates to be used: 50000 [23:48:07][9124][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [23:48:07][9124][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [23:48:07][9124][INFO ] Seed for random number generator is -1038395420. [23:48:12][9124][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [23:48:12][9124][ERROR] Demodulation failed (error: 1006)! [23:48:12][9124][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [00:03:14][536][INFO ] Starting data processing... [00:03:15][536][INFO ] CUDA device ID: 0 [00:03:15][536][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [00:03:15][536][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [00:03:15][536][INFO ] Version of installed CUDA driver: 9010 [00:03:15][536][INFO ] Version of CUDA driver API used: 3020 [00:03:49][536][INFO ] Number of generated templates to be used: 50000 [00:03:49][536][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [00:03:49][536][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [00:03:49][536][INFO ] Seed for random number generator is -1038395420. [00:03:54][536][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [00:03:54][536][ERROR] Demodulation failed (error: 1006)! [00:03:54][536][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [00:18:57][8676][INFO ] Starting data processing... [00:18:58][8676][INFO ] CUDA device ID: 0 [00:18:58][8676][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [00:18:58][8676][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [00:18:58][8676][INFO ] Version of installed CUDA driver: 9010 [00:18:58][8676][INFO ] Version of CUDA driver API used: 3020 [00:19:32][8676][INFO ] Number of generated templates to be used: 50000 [00:19:32][8676][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [00:19:32][8676][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [00:19:32][8676][INFO ] Seed for random number generator is -1038395420. [00:19:37][8676][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [00:19:37][8676][ERROR] Demodulation failed (error: 1006)! [00:19:37][8676][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [00:34:48][5100][INFO ] Starting data processing... [00:34:49][5100][INFO ] CUDA device ID: 0 [00:34:49][5100][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [00:34:49][5100][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [00:34:49][5100][INFO ] Version of installed CUDA driver: 9010 [00:34:49][5100][INFO ] Version of CUDA driver API used: 3020 [00:35:23][5100][INFO ] Number of generated templates to be used: 50000 [00:35:23][5100][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [00:35:23][5100][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [00:35:23][5100][INFO ] Seed for random number generator is -1038395420. [00:35:28][5100][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [00:35:28][5100][ERROR] Demodulation failed (error: 1006)! [00:35:28][5100][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [00:50:30][16436][INFO ] Starting data processing... [00:50:31][16436][INFO ] CUDA device ID: 0 [00:50:31][16436][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [00:50:31][16436][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [00:50:31][16436][INFO ] Version of installed CUDA driver: 9010 [00:50:31][16436][INFO ] Version of CUDA driver API used: 3020 [00:51:05][16436][INFO ] Number of generated templates to be used: 50000 [00:51:05][16436][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [00:51:05][16436][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [00:51:05][16436][INFO ] Seed for random number generator is -1038395420. [00:51:10][16436][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [00:51:10][16436][ERROR] Demodulation failed (error: 1006)! [00:51:10][16436][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [01:06:12][10776][INFO ] Starting data processing... [01:06:13][10776][INFO ] CUDA device ID: 0 [01:06:13][10776][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [01:06:13][10776][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [01:06:13][10776][INFO ] Version of installed CUDA driver: 9010 [01:06:13][10776][INFO ] Version of CUDA driver API used: 3020 [01:06:47][10776][INFO ] Number of generated templates to be used: 50000 [01:06:47][10776][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [01:06:47][10776][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [01:06:47][10776][INFO ] Seed for random number generator is -1038395420. [01:06:52][10776][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [01:06:52][10776][ERROR] Demodulation failed (error: 1006)! [01:06:52][10776][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [01:21:55][20216][INFO ] Starting data processing... [01:21:55][20216][INFO ] CUDA device ID: 0 [01:21:55][20216][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [01:21:55][20216][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [01:21:55][20216][INFO ] Version of installed CUDA driver: 9010 [01:21:55][20216][INFO ] Version of CUDA driver API used: 3020 [01:22:29][20216][INFO ] Number of generated templates to be used: 50000 [01:22:29][20216][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [01:22:29][20216][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [01:22:30][20216][INFO ] Seed for random number generator is -1038395420. [01:22:34][20216][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [01:22:34][20216][ERROR] Demodulation failed (error: 1006)! [01:22:34][20216][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [01:37:37][4428][INFO ] Starting data processing... [01:37:37][4428][INFO ] CUDA device ID: 0 [01:37:37][4428][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [01:37:37][4428][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [01:37:37][4428][INFO ] Version of installed CUDA driver: 9010 [01:37:37][4428][INFO ] Version of CUDA driver API used: 3020 [01:38:11][4428][INFO ] Number of generated templates to be used: 50000 [01:38:11][4428][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [01:38:11][4428][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [01:38:12][4428][INFO ] Seed for random number generator is -1038395420. [01:38:16][4428][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [01:38:16][4428][ERROR] Demodulation failed (error: 1006)! [01:38:16][4428][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [01:54:28][16004][INFO ] Starting data processing... [01:54:29][16004][INFO ] CUDA device ID: 0 [01:54:29][16004][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [01:54:29][16004][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [01:54:29][16004][INFO ] Version of installed CUDA driver: 9010 [01:54:29][16004][INFO ] Version of CUDA driver API used: 3020 [01:55:03][16004][INFO ] Number of generated templates to be used: 50000 [01:55:03][16004][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [01:55:03][16004][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [01:55:03][16004][INFO ] Seed for random number generator is -1038395420. [01:55:08][16004][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [01:55:08][16004][ERROR] Demodulation failed (error: 1006)! [01:55:08][16004][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [02:12:53][6672][INFO ] Starting data processing... [02:12:53][6672][INFO ] CUDA device ID: 0 [02:12:53][6672][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [02:12:53][6672][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [02:12:53][6672][INFO ] Version of installed CUDA driver: 9010 [02:12:53][6672][INFO ] Version of CUDA driver API used: 3020 [02:13:27][6672][INFO ] Number of generated templates to be used: 50000 [02:13:27][6672][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [02:13:27][6672][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [02:13:27][6672][INFO ] Seed for random number generator is -1038395420. [02:13:32][6672][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [02:13:32][6672][ERROR] Demodulation failed (error: 1006)! [02:13:32][6672][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [02:28:33][18288][INFO ] Starting data processing... [02:28:34][18288][INFO ] CUDA device ID: 0 [02:28:34][18288][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [02:28:34][18288][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [02:28:34][18288][INFO ] Version of installed CUDA driver: 9010 [02:28:34][18288][INFO ] Version of CUDA driver API used: 3020 [02:29:08][18288][INFO ] Number of generated templates to be used: 50000 [02:29:08][18288][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [02:29:08][18288][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [02:29:08][18288][INFO ] Seed for random number generator is -1038395420. [02:29:13][18288][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [02:29:13][18288][ERROR] Demodulation failed (error: 1006)! [02:29:13][18288][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... Activated exception handling... [02:44:15][144][INFO ] Starting data processing... [02:44:16][144][INFO ] CUDA device ID: 0 [02:44:16][144][INFO ] CUDA global memory status (initial GPU state, including context): ------> Used in total: 185 MB (840 MB free / 1025 MB total) -> Used by this application (assuming a single GPU task): 0 MB [02:44:16][144][INFO ] Using CUDA device #0 "Quadro K600" (192 CUDA cores / 336.19 GFLOPS) [02:44:16][144][INFO ] Version of installed CUDA driver: 9010 [02:44:16][144][INFO ] Version of CUDA driver API used: 3020 [02:44:50][144][INFO ] Number of generated templates to be used: 50000 [02:44:50][144][INFO ] Continuing work on ../../projects/einstein.phys.uwm.edu/Ter5_1_dns_cfbf00111_segment_1_dms_200_48.binary at template no. 55 [02:44:50][144][INFO ] Header contents: ------> Original WAPP file: /atlas/data/TRAPUM_GC/Terzan5/epoch1/30min_segments/dedispersed_files/cfbf00111/Ter5_1_dns_cfbf00111_segment_1_dms_200_DM234.80 ------> Sample time in microseconds: 153.121 ------> Observation time in seconds: 2568.9524 ------> Time stamp (MJD): 59097.673437067315 ------> Number of samples/record: 0 ------> Center freq in MHz: 857.5673828 ------> Channel band in MHz: 3.34375 ------> Number of channels/record: 256 ------> Nifs: 1 ------> RA (J2000): 174803.15 ------> DEC (J2000): -244732.900002 ------> Galactic l: 0 ------> Galactic b: 0 ------> Name: J1748-2446N ------> Lagformat: 0 ------> Sum: 1 ------> Level: 3 ------> AZ at start: 0 ------> ZA at start: 0 ------> AST at start: 0 ------> LST at start: 0 ------> Project ID: -- ------> Observers: -- ------> File size (bytes): 0 ------> Data size (bytes): 0 ------> Number of samples: 16777216 ------> Trial dispersion measure: 234.8 cm^-3 pc ------> Scale factor: 1.10722 [02:44:50][144][INFO ] Seed for random number generator is -1038395420. [02:44:55][144][ERROR] Couldn't allocate 7706856 bytes of CUDA HS summing memory (error: 2)! [02:44:55][144][ERROR] Demodulation failed (error: 1006)! [02:44:55][144][WARN ] Sorry, at the moment your system doesn't have enough free CPU/GPU memory to run this task! ------> Returning control to BOINC, delaying next attempt for at least 15 minutes... ------> If this problem persists you should consider aborting this task... </stderr_txt> ]]>
Language
Copyright © 2024 Einstein@Home. All rights reserved.