Task 1720947678

Name: h1_0178.80_O3aLC01Cl1In0__O3ASBu_179.00Hz_60368_0
Workunit ID: 868705261
Created: 27 Jan 2025 14:31:58 UTC
Sent: 27 Jan 2025 14:31:59 UTC
Report deadline: 3 Feb 2025 14:31:59 UTC
Received: 28 Jan 2025 20:51:52 UTC
Server state: Over
Outcome: Success
Client state: Done
Exit status: 0 (0x00000000)
Computer: 13063321
Run time (sec): 4,391.20
CPU time (sec): 4,361.48
Peak working set size (MB): 1046.81
Peak swap size (MB): 44686.88
Peak disk usage (MB): 30.46
Validation state: Valid
Granted credit: 20,000
Application: All-Sky Gravitational Wave search on O3 v1.16 (GW-cuda-3)
x86_64-pc-linux-gnu
Stderr output

<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
putenv 'LAL_DEBUG_LEVEL=3'
2025-01-28 07:30:00.6328 (59262) [normal]: This program is published under the GNU General Public License, version 2
2025-01-28 07:30:00.6329 (59262) [normal]: For details see http://einstein.phys.uwm.edu/license.php
2025-01-28 07:30:00.6329 (59262) [normal]: This Einstein@home App was built at: Mar  7 2024 14:38:26

2025-01-28 07:30:00.6329 (59262) [normal]: Start of BOINC application '../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.16_x86_64-pc-linux-gnu__GW-cuda-3'.
2025-01-28 07:30:00.6336 (59262) [debug]: Flags: LAL_DEBUG, OPTIMIZE, HS_OPTIMIZATION, GC_SSE2_OPT, CUDA, X64, SSE, SSE2, GNUC X86 GNUX86
2025-01-28 07:30:00.6336 (59262) [debug]: glibc version/release: 2.36/stable
2025-01-28 07:30:00.633701 - mytime()
2025-01-28 07:30:00.6338 (59262) [debug]: Set up communication with graphics process.
2025-01-28 07:30:00.6451 (59262) [normal]: Parsed user input successfully
Code-version: %% LAL: 7.1.4.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALPulsar: 3.1.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALApps: 7.3.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)

2025-01-28 07:30:00.6452 (59262) [normal]: Initialise compartments with freqWidth = 0.05 and candidates per compartment = 10000.
2025-01-28 07:30:00.6454 (59262) [debug]: Opening temp output file '../../projects/einstein.phys.uwm.edu/h1_0178.80_O3aLC01Cl1In0__O3ASBu_179.00Hz_60368_0_0.tmp' for writing ...
2025-01-28 07:30:00.8850 (59262) [normal]: Reading input data ... 
2025-01-28 07:30:00.8850 (59262) [normal]: Loading SFTs matching '../../projects/einstein.phys.uwm.edu/h1_0178.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0178.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0180.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0180.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0180.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0180.20_O3aLC01Cl1In0' into catalog ...2025-01-28 07:30:01.0956 (59262) [normal]: done.
2025-01-28 07:30:01.0957 (59262) [normal]: Validating SFTs (detectors: H1, L1, ) ... success.
2025-01-28 07:30:03.4318 (59262) [normal]: Search FstatMethod used: 'ResampGPU'
2025-01-28 07:30:03.4318 (59262) [normal]: Recalc FstatMethod used: 'DemodGPU'
2025-01-28 07:30:03.4318 (59262) [normal]: GPU Device used for Search/Recalc and/or semi coherent step: 'NVIDIA GeForce GTX 980'
2025-01-28 07:30:03.4319 (59262) [normal]: GPU Backend used for Search/Recalc and/or semi coherent step: 'CUDA'
2025-01-28 07:30:03.4319 (59262) [normal]: GPU version is used for the semi-coherent step!
2025-01-28 07:30:16.9414 (59262) [normal]: Number of segments: 18, total number of SFTs in segments: 5748
2025-01-28 07:30:16.9451 (59262) [normal]: Finished reading input data.
2025-01-28 07:30:16.9451 (59262) [normal]: GPS reference time = 1246070525.0000 ,  GPS data mid time = 1246070525.0000
2025-01-28 07:30:16.9451 (59262) [normal]: dFreqStack = 1.000000e-06, df1dot = 7.500000e-11, df2dot = 0.000000e+00, df3dot = 0.000000e+00
2025-01-28 07:30:16.9451 (59262) [normal]: Setup, N = 18, T = 878400 s, Tobs = 15809012 s, gammaRefine = 250, gamma2Refine = 1098, gamma3Refine = 1

DEPRECATION WARNING: program has invoked obsolete function InitDopplerSkyScan(). Please see XLALInitDopplerSkyScan() for information about a replacement.
2025-01-28 07:30:28.8401 (59262) [normal]: INFO: No checkpoint checkpoint.cpt found - starting from scratch
2025-01-28 07:30:28.8859 (59262) [normal]: Cpt:0,  total:9000,  sky:1/225,  f1dot:1/40

0.2025-01-28 07:30:28.8864 (59262) [normal]: CG:18010710 FG:1000000  f1dotmin_fg:-2.73735059761e-09 df1dot_fg:2.988047808765e-13 f2dotmin_fg:0 df2dot_fg:0 f3dotmin_fg:0 df3dot_fg:1
.......................................
1..................c
......................
2........................................
3........................................
4............c
............................
5........................................
6........................................
7.....c
...................................
8........................................
9.......................................c
.
10........................................
11........................................
12.................................c
.......
13........................................
14........................................
15...........................c
.............
16........................................
17........................................
18......................c
..................
19........................................
20........................................
21..................c
......................
22........................................
23........................................
24..............c
..........................
25........................................
26........................................
27...........c
.............................
28........................................
29........................................
30.......c
.................................
31........................................
32........................................
33.....c
...................................
34........................................
35........................................
36.c
.......................................
37........................................
38.......................................c
.
39........................................
40........................................
41.....................................c
...
42........................................
43........................................
44..................................c
......
45........................................
46........................................
47...............................c
.........
48........................................
49........................................
50............................c
............
51........................................
52........................................
53..........................c
..............
54........................................
55........................................
56.......................c
.................
57........................................
58........................................
59....................c
....................
60........................................
61........................................
62..................c
......................
63........................................
64........................................
65................c
........................
66........................................
67........................................
68...............c
.........................
69........................................
70........................................
71.............c
...........................
72........................................
73........................................
74...........c
.............................
75........................................
76........................................
77.........c
...............................
78........................................
79........................................
80.......c
.................................
81........................................
82........................................
83....c
....................................
84........................................
85........................................
86...c
.....................................
87........................................
88........................................
89...c
.....................................
90........................................
91........................................
92.c
.......................................
93........................................
94.......................................c
.
95........................................
96........................................
97......................................c
..
98........................................
99........................................
100....................................c
....
101........................................
102........................................
103..................................c
......
104........................................
105........................................
106................................c
........
107........................................
108........................................
109...............................c
.........
110........................................
111........................................
112.............................c
...........
113........................................
114........................................
115...........................c
.............
116........................................
117........................................
118..........................c
..............
119........................................
120........................................
121........................c
................
122........................................
123........................................
124.......................c
.................
125........................................
126........................................
127.....................c
...................
128........................................
129........................................
130....................c
....................
131........................................
132........................................
133....................c
....................
134........................................
135........................................
136..................c
......................
137........................................
138........................................
139.................c
.......................
140........................................
141........................................
142.................c
.......................
143........................................
144........................................
145...............c
.........................
146........................................
147........................................
148..............c
..........................
149........................................
150........................................
151............c
............................
152........................................
153........................................
154...........c
.............................
155........................................
156........................................
157.........c
...............................
158........................................
159........................................
160........c
................................
161........................................
162........................................
163......c
..................................
164........................................
165........................................
166.....c
...................................
167........................................
168........................................
169....c
....................................
170........................................
171........................................
172....c
....................................
173........................................
174........................................
175...c
.....................................
176........................................
177........................................
178...c
.....................................
179........................................
180........................................
181..c
......................................
182........................................
183........................................
184.c
.......................................
185........................................
186........................................
187.c
.......................................
188........................................
189........................................c

190..............
2025-01-28 08:35:21.738562
-- signal handler called: signal 15
XLAL Error - XLALResizeREAL4VectorGPU (/home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lalpulsar/lib/GPUUtils/GPUUtils.c:363): GPU is not initialized!
XLAL Error - XLALResizeREAL4VectorGPU (/home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lalpulsar/lib/GPUUtils/GPUUtils.c:363): Generic failure
XLAL Error - MAIN (/home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lalapps/src/pulsar/GCT/HierarchSearchGCT.c:1898): Check failed: ( finegrid.sumTwoF_GPU = XLALResizeREAL4VectorGPU ( finegrid.sumTwoF_GPU, finegrid.length ) ) != ((void *)0)
XLAL Warning - XLALSetErrno (/home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lal/lib/std/XLALError.c:349): Ignoring previous error (xlalErrno=128) Generic failure

XLAL Error - MAIN (/home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lalapps/src/pulsar/GCT/HierarchSearchGCT.c:1898): Memory allocation error
2025-01-28 08:35:21.7428 (59262) [CRITICAL]: ERROR: MAIN() returned with error '-1'
Code-version: %% LAL: 7.1.4.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALPulsar: 3.1.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALApps: 7.3.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)

FPU status flags: 
2025-01-28 08:35:21.7432 (59262) [debug]: worker done. return(-1) to caller
2025-01-28 08:35:21.7432 (59262) [normal]: done. calling boinc_finish(-1).
08:35:21 (59262): called boinc_finish
XLALCUDARelease: Total malloc from <TYPE>VectorGPU is greater than 0: 2076648573XLALCUDARelease: Total malloc from COMPLEX8FFTPlanGPU is greater than 0: 671088648 stack frames obtained for this thread:
Use gdb command: 'info line *0xADDRESS' to print corresponding line numbers.
../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.16_x86_64-pc-linux-gnu__GW-cuda-3[0x4301f7]
/lib/x86_64-linux-gnu/libc.so.6(+0x3c050)[0x7f0d565dd050]
/lib/x86_64-linux-gnu/libc.so.6(poll+0x4f)[0x7f0d5669d1df]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x2baa9f)[0x7f0d54abaa9f]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x37d82f)[0x7f0d54b7d82f]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x2b59cf)[0x7f0d54ab59cf]
/lib/x86_64-linux-gnu/libc.so.6(+0x891c4)[0x7f0d5662a1c4]
/lib/x86_64-linux-gnu/libc.so.6(+0x10985c)[0x7f0d566aa85c]

End of stacktrace
Stack trace of LAL functions in worker thread:
InitDopplerSkyScan at /home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lalpulsar/lib/DopplerScan.c:291
At lowest level status code = 0: NO LAL ERROR REGISTERED
putenv 'LAL_DEBUG_LEVEL=3'
2025-01-28 14:41:54.5948 (1194) [normal]: This program is published under the GNU General Public License, version 2
2025-01-28 14:41:54.5949 (1194) [normal]: For details see http://einstein.phys.uwm.edu/license.php
2025-01-28 14:41:54.5949 (1194) [normal]: This Einstein@home App was built at: Mar  7 2024 14:38:26

2025-01-28 14:41:54.5949 (1194) [normal]: Start of BOINC application '../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.16_x86_64-pc-linux-gnu__GW-cuda-3'.
2025-01-28 14:41:54.5997 (1194) [debug]: Flags: LAL_DEBUG, OPTIMIZE, HS_OPTIMIZATION, GC_SSE2_OPT, CUDA, X64, SSE, SSE2, GNUC X86 GNUX86
2025-01-28 14:41:54.5997 (1194) [debug]: glibc version/release: 2.36/stable
2025-01-28 14:41:54.599723 - mytime()
2025-01-28 14:41:54.5999 (1194) [debug]: Set up communication with graphics process.
2025-01-28 14:41:54.6404 (1194) [normal]: Parsed user input successfully
Code-version: %% LAL: 7.1.4.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALPulsar: 3.1.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALApps: 7.3.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)

2025-01-28 14:41:54.6405 (1194) [normal]: Initialise compartments with freqWidth = 0.05 and candidates per compartment = 10000.
2025-01-28 14:41:54.6406 (1194) [debug]: Opening temp output file '../../projects/einstein.phys.uwm.edu/h1_0178.80_O3aLC01Cl1In0__O3ASBu_179.00Hz_60368_0_0.tmp' for writing ...
2025-01-28 14:41:54.8045 (1194) [normal]: Reading input data ... 
2025-01-28 14:41:54.8045 (1194) [normal]: Loading SFTs matching '../../projects/einstein.phys.uwm.edu/h1_0178.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0178.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0179.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0179.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0180.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0180.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0180.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0180.20_O3aLC01Cl1In0' into catalog ...2025-01-28 14:41:54.9694 (1194) [normal]: done.
2025-01-28 14:41:54.9695 (1194) [normal]: Validating SFTs (detectors: H1, L1, ) ... success.
2025-01-28 14:41:56.8459 (1194) [normal]: Search FstatMethod used: 'ResampGPU'
2025-01-28 14:41:56.8459 (1194) [normal]: Recalc FstatMethod used: 'DemodGPU'
2025-01-28 14:41:56.8459 (1194) [normal]: GPU Device used for Search/Recalc and/or semi coherent step: 'NVIDIA GeForce GTX 1660 SUPER'
2025-01-28 14:41:56.8459 (1194) [normal]: GPU Backend used for Search/Recalc and/or semi coherent step: 'CUDA'
2025-01-28 14:41:56.8459 (1194) [normal]: GPU version is used for the semi-coherent step!
2025-01-28 14:42:08.2505 (1194) [normal]: Number of segments: 18, total number of SFTs in segments: 5748
2025-01-28 14:42:08.2539 (1194) [normal]: Finished reading input data.
2025-01-28 14:42:08.2539 (1194) [normal]: GPS reference time = 1246070525.0000 ,  GPS data mid time = 1246070525.0000
2025-01-28 14:42:08.2539 (1194) [normal]: dFreqStack = 1.000000e-06, df1dot = 7.500000e-11, df2dot = 0.000000e+00, df3dot = 0.000000e+00
2025-01-28 14:42:08.2540 (1194) [normal]: Setup, N = 18, T = 878400 s, Tobs = 15809012 s, gammaRefine = 250, gamma2Refine = 1098, gamma3Refine = 1

DEPRECATION WARNING: program has invoked obsolete function InitDopplerSkyScan(). Please see XLALInitDopplerSkyScan() for information about a replacement.
2025-01-28 14:42:19.4082 (1194) [normal]: Successfully read checkpoint:7600
2025-01-28 14:42:19.4768 (1194) [normal]: Cpt:7600,  total:9000,  sky:191/225,  f1dot:1/40

190.2025-01-28 14:42:19.4773 (1194) [normal]: CG:18010710 FG:1000000  f1dotmin_fg:-2.73735059761e-09 df1dot_fg:2.988047808765e-13 f2dotmin_fg:0 df2dot_fg:0 f3dotmin_fg:0 df3dot_fg:1
.......................................
191........................................
192........................c
................
193........................................
194........................................
195........................................
196........................................
197.c
.......................................
198........................................
199........................................
200........................................
201...................c
.....................
202........................................
203........................................
204........................................
205.....................................c
...
206........................................
207........................................
208........................................
209........................................
210..............c
..........................
211........................................
212........................................
213........................................
214................................c
........
215........................................
216........................................
217........................................
218........................................
219.........c
...............................
220........................................
221........................................
222........................................
223...........................c
.............
224........................................
2025-01-28 14:50:13.0753 (1194) [normal]: Finished main analysis.
2025-01-28 14:50:13.0753 (1194) [normal]: Recalculating statistics for the final toplist(s)...
2025-01-28 14:50:16.9292 (1194) [normal]: Recalculation step: 20000/200000
2025-01-28 14:50:20.7465 (1194) [normal]: Recalculation step: 40000/200000
2025-01-28 14:50:24.5708 (1194) [normal]: Recalculation step: 60000/200000
2025-01-28 14:50:28.3854 (1194) [normal]: Recalculation step: 80000/200000
2025-01-28 14:50:32.2023 (1194) [normal]: Recalculation step: 100000/200000
2025-01-28 14:50:36.0295 (1194) [normal]: Recalculation step: 120000/200000
2025-01-28 14:50:39.8510 (1194) [normal]: Recalculation step: 140000/200000
2025-01-28 14:50:43.6677 (1194) [normal]: Recalculation step: 160000/200000
2025-01-28 14:50:47.4909 (1194) [normal]: Recalculation step: 180000/200000
2025-01-28 14:50:51.3245 (1194) [normal]: Recalculation step: 200000/200000
2025-01-28 14:50:51.5202 (1194) [normal]: Finished recalculating toplist statistics.
2025-01-28 14:50:51.5202 (1194) [normal]: Finished in 536.88 s with peak RAM usage: 1392.1 MB on CPU 'AMD Ryzen 7 2700X Eight-Core Processor         ', peak VRAM usage: 2044.4 MB on GPU Device: 'NVIDIA GeForce GTX 1660 SUPER' with backend: 'CUDA'.
2025-01-28 14:50:51.6017 (1194) [debug]: Writing output ... Closing temp output file '../../projects/einstein.phys.uwm.edu/h1_0178.80_O3aLC01Cl1In0__O3ASBu_179.00Hz_60368_0_0.tmp' ... renaming temp output file '../../projects/einstein.phys.uwm.edu/h1_0178.80_O3aLC01Cl1In0__O3ASBu_179.00Hz_60368_0_0.tmp' to '../../projects/einstein.phys.uwm.edu/h1_0178.80_O3aLC01Cl1In0__O3ASBu_179.00Hz_60368_0_0' ... done.
2025-01-28 14:50:51.8230 (1194) [normal]: Restarted from checkpoint 7600

DEPRECATION WARNING: program has invoked obsolete function FreeDopplerSkyScan(). Please see XLALDestroyDopplerSkyScan() for information about a replacement.
Code-version: %% LAL: 7.1.4.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALPulsar: 3.1.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALApps: 7.3.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)

FPU status flags: 
2025-01-28 14:50:51.9082 (1194) [debug]: worker done. return(0) to caller
2025-01-28 14:50:51.9082 (1194) [normal]: done. calling boinc_finish(0).
14:50:51 (1194): called boinc_finish

</stderr_txt>
]]>