Task 1719743002

Name: h1_0177.80_O3aLC01Cl1In0__O3ASBuB_178.00Hz_16658_1
Workunit ID: 868008147
Created: 25 Jan 2025 6:48:28 UTC
Sent: 25 Jan 2025 6:48:46 UTC
Report deadline: 1 Feb 2025 6:48:46 UTC
Received: 25 Jan 2025 14:27:36 UTC
Server state: Over
Outcome: Computation error
Client state: Compute error
Exit status: 41 (0x00000029) Unknown error code
Computer: 13201321
Run time (sec): 1,445.49
CPU time (sec): 1,443.94
Peak working set size (MB): 515.51
Peak swap size (MB): 6853.97
Peak disk usage (MB): 15.24
Validation state: Invalid
Granted credit: 0
Application: All-Sky Gravitational Wave search on O3
Anonymous platform
Stderr output

<core_client_version>7.19.0</core_client_version>
<![CDATA[
<message>
process exited with code 41 (0x29, -215)</message>
<stderr_txt>
putenv 'LAL_DEBUG_LEVEL=3'
2025-01-25 08:59:20.6777 (218886) [normal]: This program is published under the GNU General Public License, version 2
2025-01-25 08:59:20.6778 (218886) [normal]: For details see http://einstein.phys.uwm.edu/license.php
2025-01-25 08:59:20.6778 (218886) [normal]: This Einstein@home App was built at: Feb 23 2024 05:11:10

2025-01-25 08:59:20.6778 (218886) [normal]: Start of BOINC application '../../projects/einstein.phys.uwm.edu/GW_einstein_O3AS_1.17_x86_64-pc-linux-gnu__GW-cuda'.
2025-01-25 08:59:20.6780 (218886) [debug]: Flags: LAL_DEBUG, OPTIMIZE, HS_OPTIMIZATION, GC_SSE2_OPT, X64, SSE, SSE2, GNUC X86 GNUX86
2025-01-25 08:59:20.6780 (218886) [debug]: glibc version/release: 2.35/stable
2025-01-25 08:59:20.678020 - mytime()
2025-01-25 08:59:20.6780 (218886) [debug]: Set up communication with graphics process.
2025-01-25 08:59:20.6816 (218886) [normal]: Parsed user input successfully
Code-version: %% LAL: 7.1.4.1 (CLEAN )
%% LALPulsar: 3.1.0.1 (CLEAN )
%% LALApps: 7.3.0.1 (UNCLEAN )

2025-01-25 08:59:20.6816 (218886) [normal]: Initialise compartments with freqWidth = 0.05 and candidates per compartment = 10000.
2025-01-25 08:59:20.6816 (218886) [debug]: Opening temp output file '../../projects/einstein.phys.uwm.edu/h1_0177.80_O3aLC01Cl1In0__O3ASBuB_178.00Hz_16658_1_0.tmp' for writing ...
2025-01-25 08:59:20.7514 (218886) [normal]: Reading input data ... 
2025-01-25 08:59:20.7514 (218886) [normal]: Loading SFTs matching '../../projects/einstein.phys.uwm.edu/h1_0177.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0177.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0178.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0178.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0178.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0178.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0178.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0178.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0178.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0178.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0178.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0178.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.20_O3aLC01Cl1In0' into catalog ...2025-01-25 08:59:20.8210 (218886) [normal]: done.
2025-01-25 08:59:20.8210 (218886) [normal]: Validating SFTs (detectors: H1, L1, ) ... success.
2025-01-25 08:59:21.6378 (218886) [normal]: Search FstatMethod used: 'ResampGPU'
2025-01-25 08:59:21.6378 (218886) [normal]: Recalc FstatMethod used: 'DemodSSE'
2025-01-25 08:59:21.6378 (218886) [normal]: GPU Device used for Search/Recalc and/or semi coherent step: 'NVIDIA TITAN V'
2025-01-25 08:59:21.6378 (218886) [normal]: GPU Backend used for Search/Recalc and/or semi coherent step: 'CUDA'
2025-01-25 08:59:21.6378 (218886) [normal]: GPU version is used for the semi-coherent step!
2025-01-25 08:59:24.7957 (218886) [normal]: Number of segments: 18, total number of SFTs in segments: 5748
2025-01-25 08:59:24.7969 (218886) [normal]: Finished reading input data.
2025-01-25 08:59:24.7969 (218886) [normal]: GPS reference time = 1246070525.0000 ,  GPS data mid time = 1246070525.0000
2025-01-25 08:59:24.7969 (218886) [normal]: dFreqStack = 1.000000e-06, df1dot = 7.500000e-11, df2dot = 0.000000e+00, df3dot = 0.000000e+00
2025-01-25 08:59:24.7969 (218886) [normal]: Setup, N = 18, T = 878400 s, Tobs = 15809012 s, gammaRefine = 250, gamma2Refine = 1098, gamma3Refine = 1

DEPRECATION WARNING: program has invoked obsolete function InitDopplerSkyScan(). Please see XLALInitDopplerSkyScan() for information about a replacement.
2025-01-25 08:59:28.6785 (218886) [normal]: INFO: No checkpoint checkpoint.cpt found - starting from scratch
2025-01-25 08:59:28.6858 (218886) [normal]: Cpt:0,  total:9000,  sky:1/225,  f1dot:1/40

0.2025-01-25 08:59:28.6860 (218886) [normal]: CG:9010710 FG:500000  f1dotmin_fg:-2.73735059761e-09 df1dot_fg:2.988047808765e-13 f2dotmin_fg:0 df2dot_fg:0 f3dotmin_fg:0 df3dot_fg:1
.......................................
1........................................
2........................................
3........................................
4........................................
5........................................
6........................................
7........................................
8................c
........................
9........................................
10........................................
11........................................
12........................................
13........................................
14........................................
15........................................
16........................................
17........................................
18.................c
.......................
19........................................
20........................................
21........................................
22........................................
23........................................
24........................................
25........................................
26........................................
27........................................
28.........................c
...............
29........................................
30........................................
31........................................
32........................................
33........................................
34........................................
35........................................
36........................................
37........................................
38...................................c
.....
39........................................
40........................................
41........................................
42........................................
43........................................
44........................................
45........................................
46........................................
47........................................
48........................................
49......c
..................................
50........................................
51........................................
52........................................
53........................................
54........................................
55........................................
56........................................
57........................................
58........................................
59...................c
.....................
60........................................
61........................................
62........................................
63........................................
64........................................
65........................................
66........................................
67........................................
68........................................
69...............................c
.........
70........................................
71........................................
72........................................
73........................................
74........................................
75........................................
76........................................
77........................................
78........................................
79........................................
80...c
.....................................
81........................................
82........................................
83........................................
84........................................
85........................................
86........................................
87........................................
88........................................
89........................................
90................c
........................
91........................................
92........................................
93........................................
94........................................
95........................................
96........................................
97........................................
98........................................
99........................................
100............................c
............
101........................................
102........................................
103........................................
104........................................
105........................................
106........................................
107........................................
108........................................
109........................................
110........................................c

111........................................
112........................................
113........................................
114........................................
115........................................
116........................................
117........................................
118........................................
119........................................
120........................................
121............c
............................
122........................................
123........................................
124........................................
125........................................
126........................................
127........................................
128........................................
129........................................
130........................................
131.........................c
...............
132........................................
133........................................
134........................................
135........................................
136........................................
137........................................
138........................................
139........................................
140........................................
141....................................c
....
142........................................
143........................................
144........................................
145........................................
146........................................
147........................................
148........................................
149........................................
150........................................
151........................................
152........c
................................
153........................................
154........................................
155........................................
156........................................
157........................................
158........................................
159........................................
160........................................
161........................................
162...................c
.....................
163........................................
164........................................
165........................................
166........................................
167........................................
168........................................
169........................................
170........................................
171........................................
172.............................c
...........
173........................................
174........................................
175........................................
176........................................
177........................................
178........................................
179........................................
180........................................
181........................................
182........................................
183.c
.......................................
184........................................
185........................................
186........................................
187........................................
188........................................
189........................................
190........................................
191........................................
192........................................
193............c
............................
194........................................
195........................................
196........................................
197........................................
198........................................
199........................................
200........................................
201........................................
202........................................
203......................c
..................
204........................................
205........................................
206........................................
207........................................
208........................................
209........................................
210........................................
211........................................
212........................................
213.................................c
.......
214........................................
215........................................
216........................................
217........................................
218........................................
219........................................
220........................................
221........................................
222........................................
223........................................
224........................................
2025-01-25 09:21:11.9537 (218886) [normal]: Finished main analysis.
2025-01-25 09:21:11.9537 (218886) [normal]: Recalculating statistics for the final toplist(s)...
2025-01-25 09:21:27.1989 (218886) [normal]: Finished recalculating toplist statistics.
2025-01-25 09:21:27.1990 (218886) [normal]: Finished in 1326.52 s with peak RAM usage: 1303.5 MB on CPU '<unknown>', peak VRAM usage: 931.8 MB on GPU Device: 'NVIDIA TITAN V' with backend: 'CUDA'.
2025-01-25 09:21:27.2122 (218886) [debug]: Writing output ... Closing temp output file '../../projects/einstein.phys.uwm.edu/h1_0177.80_O3aLC01Cl1In0__O3ASBuB_178.00Hz_16658_1_0.tmp' ... renaming temp output file '../../projects/einstein.phys.uwm.edu/h1_0177.80_O3aLC01Cl1In0__O3ASBuB_178.00Hz_16658_1_0.tmp' to '../../projects/einstein.phys.uwm.edu/h1_0177.80_O3aLC01Cl1In0__O3ASBuB_178.00Hz_16658_1_0' ... done.

DEPRECATION WARNING: program has invoked obsolete function FreeDopplerSkyScan(). Please see XLALDestroyDopplerSkyScan() for information about a replacement.
2025-01-25 09:21:27.2705 (218886) [normal]: Parsed user input successfully
Code-version: %% LAL: 7.1.4.1 (CLEAN )
%% LALPulsar: 3.1.0.1 (CLEAN )
%% LALApps: 7.3.0.1 (UNCLEAN )

2025-01-25 09:21:27.2705 (218886) [normal]: Initialise compartments with freqWidth = 0.05 and candidates per compartment = 10000.
2025-01-25 09:21:27.2706 (218886) [debug]: Opening temp output file '../../projects/einstein.phys.uwm.edu/h1_0177.80_O3aLC01Cl1In0__O3ASBuB_178.00Hz_16658_1_1.tmp' for writing ...
2025-01-25 09:21:27.3333 (218886) [normal]: Reading input data ... 
2025-01-25 09:21:27.3333 (218886) [normal]: Loading SFTs matching '../../projects/einstein.phys.uwm.edu/h1_0177.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0177.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0178.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0178.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0178.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0178.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0178.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0178.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0178.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0178.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0178.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0178.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.20_O3aLC01Cl1In0' into catalog ...2025-01-25 09:21:27.4061 (218886) [normal]: done.
2025-01-25 09:21:27.4061 (218886) [normal]: Validating SFTs (detectors: H1, L1, ) ... success.
2025-01-25 09:21:28.1717 (218886) [normal]: Search FstatMethod used: 'ResampGPU'
2025-01-25 09:21:28.1717 (218886) [normal]: Recalc FstatMethod used: 'DemodSSE'
2025-01-25 09:21:28.1717 (218886) [normal]: GPU Device used for Search/Recalc and/or semi coherent step: 'NVIDIA TITAN V'
2025-01-25 09:21:28.1717 (218886) [normal]: GPU Backend used for Search/Recalc and/or semi coherent step: 'CUDA'
2025-01-25 09:21:28.1717 (218886) [normal]: GPU version is used for the semi-coherent step!
2025-01-25 09:21:30.6430 (218886) [normal]: Number of segments: 18, total number of SFTs in segments: 5748
2025-01-25 09:21:30.6443 (218886) [normal]: Finished reading input data.
2025-01-25 09:21:30.6443 (218886) [normal]: GPS reference time = 1246070525.0000 ,  GPS data mid time = 1246070525.0000
2025-01-25 09:21:30.6443 (218886) [normal]: dFreqStack = 1.000000e-06, df1dot = 7.500000e-11, df2dot = 0.000000e+00, df3dot = 0.000000e+00
2025-01-25 09:21:30.6443 (218886) [normal]: Setup, N = 18, T = 878400 s, Tobs = 15809012 s, gammaRefine = 250, gamma2Refine = 1098, gamma3Refine = 1
2025-01-25 09:21:34.4163 (218886) [normal]: INFO: No checkpoint checkpoint.cpt found - starting from scratch
2025-01-25 09:21:34.4230 (218886) [normal]: Cpt:0,  total:9000,  sky:1/225,  f1dot:1/40

0.2025-01-25 09:21:34.4232 (218886) [normal]: CG:9010710 FG:500000  f1dotmin_fg:-2.73735059761e-09 df1dot_fg:2.988047808765e-13 f2dotmin_fg:0 df2dot_fg:0 f3dotmin_fg:0 df3dot_fg:1
c
.......................................
1........................................
2........................................
3........................................
4........................................
5........................................
6........................................
7........................................
8........................................
9............................c
............
10........................................
11........................................
12........................................
13........................................
14........................................
15........................................
16........................................
17........................................
2025-01-25 09:23:23.757887
-- signal handler called: signal 11
XLALCUDARelease: Total malloc from <TYPE>VectorGPU is greater than 0: 943576909XLALCUDARelease: Total malloc from COMPLEX8FFTPlanGPU is greater than 0: 3355443216 stack frames obtained for this thread:
Use gdb command: 'info line *0xADDRESS' to print corresponding line numbers.
../../projects/einstein.phys.uwm.edu/GW_einstein_O3AS_1.17_x86_64-pc-linux-gnu__GW-cuda[0x42c484]
/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7c62efc42520]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x231d4a)[0x7c62ee231d4a]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x1423ae)[0x7c62ee1423ae]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x2ebe79)[0x7c62ee2ebe79]
../../projects/einstein.phys.uwm.edu/GW_einstein_O3AS_1.17_x86_64-pc-linux-gnu__GW-cuda[0xd2ab5c]
../../projects/einstein.phys.uwm.edu/GW_einstein_O3AS_1.17_x86_64-pc-linux-gnu__GW-cuda[0xcf6c73]
../../projects/einstein.phys.uwm.edu/GW_einstein_O3AS_1.17_x86_64-pc-linux-gnu__GW-cuda[0xd46328]
../../projects/einstein.phys.uwm.edu/GW_einstein_O3AS_1.17_x86_64-pc-linux-gnu__GW-cuda[0x5aceb5]
../../projects/einstein.phys.uwm.edu/GW_einstein_O3AS_1.17_x86_64-pc-linux-gnu__GW-cuda[0x5b4fc2]
../../projects/einstein.phys.uwm.edu/GW_einstein_O3AS_1.17_x86_64-pc-linux-gnu__GW-cuda[0x41ddd2]
../../projects/einstein.phys.uwm.edu/GW_einstein_O3AS_1.17_x86_64-pc-linux-gnu__GW-cuda[0x424415]
../../projects/einstein.phys.uwm.edu/GW_einstein_O3AS_1.17_x86_64-pc-linux-gnu__GW-cuda[0x40b2b8]
/lib/x86_64-linux-gnu/libc.so.6(+0x29d90)[0x7c62efc29d90]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x80)[0x7c62efc29e40]
../../projects/einstein.phys.uwm.edu/GW_einstein_O3AS_1.17_x86_64-pc-linux-gnu__GW-cuda[0x40ea50]

End of stacktrace
Stack trace of LAL functions in worker thread:
InitDopplerSkyScan at /home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lalpulsar/lib/DopplerScan.c:291
At lowest level status code = 0: NO LAL ERROR REGISTERED
09:23:23 (218886): called boinc_finish

</stderr_txt>
]]>