Task 1694329433

Name: h1_0160.80_O3aLC01Cl1In0__O3ASBu_161.00Hz_47087_2
Workunit ID: 850736599
Created: 9 Dec 2024 16:45:26 UTC
Sent: 9 Dec 2024 16:52:13 UTC
Report deadline: 16 Dec 2024 16:52:13 UTC
Received: 9 Dec 2024 21:56:29 UTC
Server state: Over
Outcome: Success
Client state: Done
Exit status: 0 (0x00000000)
Computer: 12924906
Run time (sec): 12,255.20
CPU time (sec): 12,177.57
Peak working set size (MB): 1023.43
Peak swap size (MB): 40179.77
Peak disk usage (MB): 30.46
Validation state: Valid
Granted credit: 3,000
Application: All-Sky Gravitational Wave search on O3 v1.15 (GW-cuda)
x86_64-pc-linux-gnu
Stderr output

<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
putenv 'LAL_DEBUG_LEVEL=3'
2024-12-09 13:06:29.4059 (2077444) [normal]: This program is published under the GNU General Public License, version 2
2024-12-09 13:06:29.4059 (2077444) [normal]: For details see http://einstein.phys.uwm.edu/license.php
2024-12-09 13:06:29.4059 (2077444) [normal]: This Einstein@home App was built at: Feb 23 2024 05:11:10

2024-12-09 13:06:29.4059 (2077444) [normal]: Start of BOINC application '../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.15_x86_64-pc-linux-gnu__GW-cuda'.
2024-12-09 13:06:29.4064 (2077444) [debug]: Flags: LAL_DEBUG, OPTIMIZE, HS_OPTIMIZATION, GC_SSE2_OPT, X64, SSE, SSE2, GNUC X86 GNUX86
2024-12-09 13:06:29.4064 (2077444) [debug]: glibc version/release: 2.31/stable
2024-12-09 13:06:29.406498 - mytime()
2024-12-09 13:06:29.4065 (2077444) [debug]: Set up communication with graphics process.
2024-12-09 13:06:29.4314 (2077444) [normal]: Parsed user input successfully
Code-version: %% LAL: 7.1.4.1 (CLEAN )
%% LALPulsar: 3.1.0.1 (CLEAN )
%% LALApps: 7.3.0.1 (UNCLEAN )

2024-12-09 13:06:29.4544 (2077444) [normal]: Initialise compartments with freqWidth = 0.05 and candidates per compartment = 10000.
2024-12-09 13:06:29.4545 (2077444) [debug]: Opening temp output file '../../projects/einstein.phys.uwm.edu/h1_0160.80_O3aLC01Cl1In0__O3ASBu_161.00Hz_47087_2_0.tmp' for writing ...
2024-12-09 13:06:29.6628 (2077444) [normal]: Reading input data ... 
2024-12-09 13:06:29.6629 (2077444) [normal]: Loading SFTs matching '../../projects/einstein.phys.uwm.edu/h1_0160.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0160.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0161.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0161.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0161.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0161.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0161.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0161.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0161.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0161.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0161.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0161.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0162.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0162.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0162.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0162.20_O3aLC01Cl1In0' into catalog ...2024-12-09 13:06:29.8304 (2077444) [normal]: done.
2024-12-09 13:06:29.8304 (2077444) [normal]: Validating SFTs (detectors: H1, L1, ) ... success.
2024-12-09 13:06:31.8485 (2077444) [normal]: Search FstatMethod used: 'ResampGPU'
2024-12-09 13:06:31.8485 (2077444) [normal]: Recalc FstatMethod used: 'DemodSSE'
2024-12-09 13:06:31.8485 (2077444) [normal]: GPU Device used for Search/Recalc and/or semi coherent step: 'Tesla K20Xm'
2024-12-09 13:06:31.8486 (2077444) [normal]: GPU Backend used for Search/Recalc and/or semi coherent step: 'CUDA'
2024-12-09 13:06:31.8486 (2077444) [normal]: GPU version is used for the semi-coherent step!
2024-12-09 13:06:45.2204 (2077444) [normal]: Number of segments: 18, total number of SFTs in segments: 5748
2024-12-09 13:06:45.2228 (2077444) [normal]: Finished reading input data.
2024-12-09 13:06:45.2229 (2077444) [normal]: GPS reference time = 1246070525.0000 ,  GPS data mid time = 1246070525.0000
2024-12-09 13:06:45.2229 (2077444) [normal]: dFreqStack = 1.000000e-06, df1dot = 7.500000e-11, df2dot = 0.000000e+00, df3dot = 0.000000e+00
2024-12-09 13:06:45.2229 (2077444) [normal]: Setup, N = 18, T = 878400 s, Tobs = 15809012 s, gammaRefine = 250, gamma2Refine = 1098, gamma3Refine = 1

DEPRECATION WARNING: program has invoked obsolete function InitDopplerSkyScan(). Please see XLALInitDopplerSkyScan() for information about a replacement.
2024-12-09 13:06:53.0773 (2077444) [normal]: INFO: No checkpoint checkpoint.cpt found - starting from scratch
2024-12-09 13:06:53.0879 (2077444) [normal]: Cpt:0,  total:9000,  sky:1/225,  f1dot:1/40

0.2024-12-09 13:06:53.0885 (2077444) [normal]: CG:18010710 FG:1000000  f1dotmin_fg:-2.73735059761e-09 df1dot_fg:2.988047808765e-13 f2dotmin_fg:0 df2dot_fg:0 f3dotmin_fg:0 df3dot_fg:1
..........................c
.............
1................................c
........
2....................................c
....
3........................................c

4........................................
5....c
....................................
6.........c
...............................
7.............c
...........................
8..................c
......................
9.......................c
.................
10............................c
............
11.................................c
.......
12......................................c
..
13........................................
14..c
......................................
15.......c
.................................
16............c
............................
17.................c
.......................
18......................c
..................
19...........................c
.............
20................................c
........
21....................................c
....
22........................................
23.c
.......................................
24......c
..................................
25...........c
.............................
26................c
........................
27.....................c
...................
28..........................c
..............
29...............................c
.........
30....................................c
....
31........................................
32.c
.......................................
33......c
..................................
34...........c
.............................
35................c
........................
36.....................c
...................
37...........................c
.............
38................................c
........
39.....................................c
...
40........................................
41.c
.......................................
42......c
..................................
43...........c
.............................
44................c
........................
45.....................c
...................
46..........................c
..............
47...............................c
.........
48....................................c
....
49........................................c

50........................................
51.....c
...................................
52..........c
..............................
53...............c
.........................
54....................c
....................
55.........................c
...............
56..............................c
..........
57...................................c
.....
58........................................c

59........................................
60.....c
...................................
61..........c
..............................
62...............c
.........................
63....................c
....................
64.........................c
...............
65..............................c
..........
66...................................c
.....
67........................................c

68........................................
69.....c
...................................
70..........c
..............................
71...............c
.........................
72....................c
....................
73.........................c
...............
74..............................c
..........
75...................................c
.....
76........................................c

77........................................
78.....c
...................................
79..........c
..............................
80...............c
.........................
81....................c
....................
82.........................c
...............
83..............................c
..........
84...................................c
.....
85........................................c

86........................................
87.....c
...................................
88..........c
..............................
89...............c
.........................
90....................c
....................
91.........................c
...............
92..............................c
..........
93...................................c
.....
94........................................c

95........................................
96.....c
...................................
97..........c
..............................
98...............c
.........................
99....................c
....................
100.........................c
...............
101..............................c
..........
102...................................c
.....
103........................................c

104........................................
105.....c
...................................
106..........c
..............................
107...............c
.........................
108....................c
....................
109.........................c
...............
110..............................c
..........
111...................................c
.....
112........................................c

113........................................
114.....c
...................................
115..........c
..............................
116...............c
.........................
117....................c
....................
118.........................c
...............
119..............................c
..........
120...................................c
.....
121........................................c

122........................................
123.....c
...................................
124..........c
..............................
125...............c
.........................
126....................c
....................
127.........................c
...............
128..............................c
..........
129...................................c
.....
130........................................c

131........................................
132.....c
...................................
133..........c
..............................
134...............c
.........................
135....................c
....................
136.........................c
...............
137..............................c
..........
138...................................c
.....
139........................................c

140........................................
141....c
....................................
142.........c
...............................
143..............c
..........................
144...................c
.....................
145........................c
................
146.............................c
...........
147..................................c
......
148.......................................c
.
149........................................
150....c
....................................
151.........c
...............................
152..............c
..........................
153........................................
154.................c
.......................
155........................................
156.......c
.................................
157..c
..................................c
....
158..............................c
..........
159..............
2024-12-09 15:30:01.485740
-- signal handler called: signal 15
XLALCUDARelease: Total malloc from <TYPE>VectorGPU is greater than 0: 1856123501XLALCUDARelease: Total malloc from COMPLEX8FFTPlanGPU is greater than 0: 6710886420 stack frames obtained for this thread:
Use gdb command: 'info line *0xADDRESS' to print corresponding line numbers.
../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.15_x86_64-pc-linux-gnu__GW-cuda[0x42c484]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f09839b3420]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x35d3ba)[0x7f098225f3ba]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x1a1913)[0x7f09820a3913]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x1f5bd5)[0x7f09820f7bd5]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x42c7a6)[0x7f098232e7a6]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x42d311)[0x7f098232f311]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x2749b7)[0x7f09821769b7]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x1f606f)[0x7f09820f806f]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x1f76b8)[0x7f09820f96b8]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x316aaa)[0x7f0982218aaa]
../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.15_x86_64-pc-linux-gnu__GW-cuda[0xd0685d]
../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.15_x86_64-pc-linux-gnu__GW-cuda[0xd2b429]
../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.15_x86_64-pc-linux-gnu__GW-cuda[0x5ad2b5]
../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.15_x86_64-pc-linux-gnu__GW-cuda[0x5b8c79]
../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.15_x86_64-pc-linux-gnu__GW-cuda[0x41de5e]
../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.15_x86_64-pc-linux-gnu__GW-cuda[0x424415]
../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.15_x86_64-pc-linux-gnu__GW-cuda[0x40b2b8]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f0983682083]
../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.15_x86_64-pc-linux-gnu__GW-cuda[0x40ea50]

End of stacktrace
Stack trace of LAL functions in worker thread:
InitDopplerSkyScan at /home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lalpulsar/lib/DopplerScan.c:291
At lowest level status code = 0: NO LAL ERROR REGISTERED
15:30:01 (2077444): called boinc_finish
putenv 'LAL_DEBUG_LEVEL=3'
2024-12-09 15:45:41.6244 (2131757) [normal]: This program is published under the GNU General Public License, version 2
2024-12-09 15:45:41.6244 (2131757) [normal]: For details see http://einstein.phys.uwm.edu/license.php
2024-12-09 15:45:41.6244 (2131757) [normal]: This Einstein@home App was built at: Feb 23 2024 05:11:10

2024-12-09 15:45:41.6244 (2131757) [normal]: Start of BOINC application '../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.15_x86_64-pc-linux-gnu__GW-cuda'.
2024-12-09 15:45:41.6249 (2131757) [debug]: Flags: LAL_DEBUG, OPTIMIZE, HS_OPTIMIZATION, GC_SSE2_OPT, X64, SSE, SSE2, GNUC X86 GNUX86
2024-12-09 15:45:41.6249 (2131757) [debug]: glibc version/release: 2.31/stable
2024-12-09 15:45:41.624931 - mytime()
2024-12-09 15:45:41.6250 (2131757) [debug]: Set up communication with graphics process.
2024-12-09 15:45:41.6486 (2131757) [normal]: Parsed user input successfully
Code-version: %% LAL: 7.1.4.1 (CLEAN )
%% LALPulsar: 3.1.0.1 (CLEAN )
%% LALApps: 7.3.0.1 (UNCLEAN )

2024-12-09 15:45:41.6486 (2131757) [normal]: Initialise compartments with freqWidth = 0.05 and candidates per compartment = 10000.
2024-12-09 15:45:41.6487 (2131757) [debug]: Opening temp output file '../../projects/einstein.phys.uwm.edu/h1_0160.80_O3aLC01Cl1In0__O3ASBu_161.00Hz_47087_2_0.tmp' for writing ...
2024-12-09 15:45:41.8413 (2131757) [normal]: Reading input data ... 
2024-12-09 15:45:41.8414 (2131757) [normal]: Loading SFTs matching '../../projects/einstein.phys.uwm.edu/h1_0160.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0160.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0161.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0161.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0161.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0161.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0161.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0161.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0161.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0161.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0161.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0161.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0162.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0162.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0162.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0162.20_O3aLC01Cl1In0' into catalog ...2024-12-09 15:45:42.0308 (2131757) [normal]: done.
2024-12-09 15:45:42.0309 (2131757) [normal]: Validating SFTs (detectors: H1, L1, ) ... success.
2024-12-09 15:45:43.9520 (2131757) [normal]: Search FstatMethod used: 'ResampGPU'
2024-12-09 15:45:43.9520 (2131757) [normal]: Recalc FstatMethod used: 'DemodSSE'
2024-12-09 15:45:43.9520 (2131757) [normal]: GPU Device used for Search/Recalc and/or semi coherent step: 'Tesla K20Xm'
2024-12-09 15:45:43.9520 (2131757) [normal]: GPU Backend used for Search/Recalc and/or semi coherent step: 'CUDA'
2024-12-09 15:45:43.9520 (2131757) [normal]: GPU version is used for the semi-coherent step!
2024-12-09 15:45:58.6563 (2131757) [normal]: Number of segments: 18, total number of SFTs in segments: 5748
2024-12-09 15:45:58.6615 (2131757) [normal]: Finished reading input data.
2024-12-09 15:45:58.6615 (2131757) [normal]: GPS reference time = 1246070525.0000 ,  GPS data mid time = 1246070525.0000
2024-12-09 15:45:58.6615 (2131757) [normal]: dFreqStack = 1.000000e-06, df1dot = 7.500000e-11, df2dot = 0.000000e+00, df3dot = 0.000000e+00
2024-12-09 15:45:58.6615 (2131757) [normal]: Setup, N = 18, T = 878400 s, Tobs = 15809012 s, gammaRefine = 250, gamma2Refine = 1098, gamma3Refine = 1

DEPRECATION WARNING: program has invoked obsolete function InitDopplerSkyScan(). Please see XLALInitDopplerSkyScan() for information about a replacement.
2024-12-09 15:46:07.0655 (2131757) [normal]: Successfully read checkpoint:6350
2024-12-09 15:46:07.0937 (2131757) [normal]: Cpt:6350,  total:9000,  sky:159/225,  f1dot:31/40

158.2024-12-09 15:46:07.0943 (2131757) [normal]: CG:18010710 FG:1000000  f1dotmin_fg:-4.873505976096e-10 df1dot_fg:2.988047808765e-13 f2dotmin_fg:0 df2dot_fg:0 f3dotmin_fg:0 df3dot_fg:1
.........
159................c
........................
160.....................c
...................
161..........................c
..............
162...............................c
.........
163....................................c
....
164........................................
165.c
.......................................
166.....c
...................................
167..........c
..............................
168...............c
.........................
169....................c
....................
170.........................c
...............
171..............................c
..........
172...................................c
.....
173........................................c

174........................................
175....c
....................................
176.........c
...............................
177..............c
..........................
178...................c
.....................
179.......................c
.................
180............................c
............
181.................................c
.......
182.....................................c
...
183........................................
184..c
......................................
185.......c
.................................
186............c
............................
187................c
........................
188.....................c
...................
189..........................c
..............
190...............................c
.........
191....................................c
....
192........................................
193.c
.......................................
194......c
..................................
195...........c
.............................
196................c
........................
197....................c
....................
198.........................c
...............
199..............................c
..........
200..................................c
......
201.......................................c
.
202........................................
203....c
....................................
204.........c
...............................
205..............c
..........................
206..................c
......................
207.......................c
.................
208............................c
............
209.................................c
.......
210......................................c
..
211........................................
212..c
......................................
213......c
..................................
214..........c
..............................
215..............c
..........................
216..................c
......................
217........................................
218.......c
.................................
219........................................
220..............c
..........................
221.........c
...............................
222....c
..................................c
..
223...............................c
.........
224.......................c
.................
2024-12-09 16:45:47.3382 (2131757) [normal]: Finished main analysis.
2024-12-09 16:45:47.3382 (2131757) [normal]: Recalculating statistics for the final toplist(s)...
2024-12-09 16:47:05.3864 (2131757) [normal]: Finished recalculating toplist statistics.
2024-12-09 16:47:05.3865 (2131757) [normal]: Finished in 0.00 s with peak RAM usage: 1139.5 MB on CPU 'Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz', peak VRAM usage: 1834.1 MB on GPU Device: 'Tesla K20Xm' with backend: 'CUDA'.
2024-12-09 16:47:05.4035 (2131757) [debug]: Writing output ... Closing temp output file '../../projects/einstein.phys.uwm.edu/h1_0160.80_O3aLC01Cl1In0__O3ASBu_161.00Hz_47087_2_0.tmp' ... renaming temp output file '../../projects/einstein.phys.uwm.edu/h1_0160.80_O3aLC01Cl1In0__O3ASBu_161.00Hz_47087_2_0.tmp' to '../../projects/einstein.phys.uwm.edu/h1_0160.80_O3aLC01Cl1In0__O3ASBu_161.00Hz_47087_2_0' ... done.
2024-12-09 16:47:05.5487 (2131757) [normal]: Restarted from checkpoint 6350

DEPRECATION WARNING: program has invoked obsolete function FreeDopplerSkyScan(). Please see XLALDestroyDopplerSkyScan() for information about a replacement.
Code-version: %% LAL: 7.1.4.1 (CLEAN )
%% LALPulsar: 3.1.0.1 (CLEAN )
%% LALApps: 7.3.0.1 (UNCLEAN )

FPU status flags:  COND_1 PRECISION
2024-12-09 16:47:05.7773 (2131757) [debug]: worker done. return(0) to caller
2024-12-09 16:47:05.7773 (2131757) [normal]: done. calling boinc_finish(0).
16:47:05 (2131757): called boinc_finish

</stderr_txt>
]]>