Relieving space congestion w/new app, i.e., BRP4

Professor Ray
Professor Ray
Joined: 22 Feb 05
Posts: 46
Credit: 12529709
RAC: 1053
Topic 196238

The following files are contained in my Einstein project folder:

eah_slide_02.png
eah_slide_05.png
eah_slide_07.png
eah_slide_08.png
eah_slide_11.png
eah_slide_12.png
eah_slide_13.png
earth_05_09
earth_09_11
einsteinbinary_ABP2_3.03_graphics_windows_intelx86.exe
einsteinbinary_ABP2_3.08_windows_intelx86.exe
einsteinbinary_BRP3_1.00_graphics_windows_intelx86.exe
einsteinbinary_BRP4_1.00_graphics_windows_intelx86.exe
einsteinbinary_BRP4_1.00_windows_intelx86__BRP3SSE.exe
einsteinbinary_BRP4_1.22_windows_intelx86__BRP4SSE.exe
einstein_icon.png
einstein_S5GC1_3.02_windows_intelx86.exe
einstein_S5GC1_3.02_windows_intelx86__S5GCESSE.exe
einstein_S5GCE_3.04_windows_intelx86__S5GCESSE.exe
einstein_S5R6_3.01_graphics_windows_intelx86.exe
einstein_S5R6_3.01_windows_intelx86__S5R6sse.exe
einstein_S6Bucket_1.02_windows_intelx86__SSE.exe
h1_0242.80_S6GC1
h1_0242.85_S6GC1
h1_0242.90_S6GC1
h1_0242.95_S6GC1
h1_0243.00_S6GC1
h1_0243.05_S6GC1
h1_0287.75_S6GC1
h1_0287.80_S6GC1
h1_0287.85_S6GC1
h1_0287.90_S6GC1
h1_0287.95_S6GC1
h1_0288.00_S6GC1
h1_0393.90_S6GC1
h1_0393.95_S6GC1
h1_0394.00_S6GC1
h1_0394.05_S6GC1
h1_0394.10_S6GC1
h1_0394.15_S6GC1
h1_0394.20_S6GC1
h1_0394.25_S6GC1
h1_0400.65_S6GC1
h1_0400.70_S6GC1
h1_0400.75_S6GC1
h1_0400.80_S6GC1
h1_0400.85_S6GC1
h1_0400.90_S6GC1
h1_0447.75_S6GC1
h1_0447.80_S6GC1
h1_0447.85_S6GC1
h1_0447.90_S6GC1
h1_0447.95_S6GC1
h1_0448.00_S6GC1
hsgamma_FGRP1_0.23_windows_intelx86.exe
JPLEPH.405
l1_0242.80_S6GC1
l1_0242.85_S6GC1
l1_0242.90_S6GC1
l1_0242.95_S6GC1
l1_0243.00_S6GC1
l1_0243.05_S6GC1
l1_0287.75_S6GC1
l1_0287.80_S6GC1
l1_0287.85_S6GC1
l1_0287.90_S6GC1
l1_0287.95_S6GC1
l1_0288.00_S6GC1
l1_0393.90_S6GC1
l1_0393.95_S6GC1
l1_0394.00_S6GC1
l1_0394.05_S6GC1
l1_0394.10_S6GC1
l1_0394.15_S6GC1
l1_0394.20_S6GC1
l1_0394.25_S6GC1
l1_0400.65_S6GC1
l1_0400.70_S6GC1
l1_0400.75_S6GC1
l1_0400.80_S6GC1
l1_0400.85_S6GC1
l1_0400.90_S6GC1
l1_0447.75_S6GC1
l1_0447.80_S6GC1
l1_0447.85_S6GC1
l1_0447.90_S6GC1
l1_0447.95_S6GC1
l1_0448.00_S6GC1
LATeah2314A.dat
p2030.20111003.G37.79-00.04.C.b4s0g0.00000.zap
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1448.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1449.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1450.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1451.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1452.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1453.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1454.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1455.bin4

S6GC1_T60h_v1_Segments.seg
skygrid_LATeah2314A_0096.0.dat
slideshow_einsteinbinary_BRP4_00
slideshow_einsteinbinary_BRP4_01
slideshow_einsteinbinary_BRP4_02
slideshow_einsteinbinary_BRP4_03
slideshow_einsteinbinary_BRP4_04
slideshow_einstein_S6Bucket_00
slideshow_einstein_S6Bucket_01
slideshow_einstein_S6Bucket_02
slideshow_einstein_S6Bucket_03
slideshow_einstein_S6Bucket_04
stat_icon
stochastic_full.bank

sun_05_09
sun_09_11
symbols\ [~20.6MB folder]

The files in bold were downloaded 12 Mar 14 (non-bolded files listed were downloaded en masse between 12 Mar 10 2315 & 12 Mar 11 0054). I presently have two WU's, i.e., Gamma Ray Pulsar Search #1 0.23 [54% complete] & Binary Radio Pulsar Search (Arecibo) 1.22 (BRP4SSE). When the GRPS #1 WU completes, which one of the aforementioned files in the file list can I delete w/out deleting WU specific stuff; given the 510MB I have free, I'm drooling at the prospect of freeing up 300MB.

Bikeman (Heinz-Bernd Eggenstein)
Bikeman (Heinz-...
Moderator
Joined: 28 Aug 06
Posts: 3522
Credit: 735619516
RAC: 1280250

Relieving space congestion w/new app, i.e., BRP4

Hi!

Well, some of the older executabel files are definitely obsolete now, but the l1* ad h1* files are the ones that really take up most of the space. Even tho none of your current jobs uses them, they are kept because if you get your next GW job, Einstein@Home will try to give you a task that matches all or most of your data files. This is a trade-off between saving disk space and download bandwidth. So even if you deleted those files, they will soon be replaced by freshly downloaded data files.

To restrict the disk space that BOINC may use, you can use various settings in your preferences if you are concerned that BOINC will take too much space.

HB

MarkJ
MarkJ
Joined: 28 Feb 08
Posts: 437
Credit: 139002861
RAC: 0

Another thing you can

Another thing you can do:

1. Set Einstein to NNT (no new tasks)
2. Let if finish off all its Einstein work -and- report it
3. Detach from the project
4. Add Einstein as a project again

This will have the effect of deleting the Einstein files off your machine. It will re-download the current exe files and some current wu. You don't have to work out which files are needed and which are not.

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4312
Credit: 250730726
RAC: 35710

The files of the "Gamma Ray

The files of the "Gamma Ray Pulsar search" will be deleted automatically when the task finished (with exception of the file JPLEPH.405), unless you have more GRP work already on your computer. Likewise with the files belonging to BRP ("Binary radio Pulsar Search"), i.e. the p2030_*.bin4.

You could save space on the GW search files (S6LV1 and S6Bucket, files h1_* and l1_*). These will be kept on your computer by BOINC as long as you don't run out of disk space as set in your computing preferences, and as long there is work available on the server that could use this files. This is as to avoid unnecessary downloads.

You could delete these manually, but you would have to stop the Client and manually edit the client_state.xml file for this - or the client would take the deletion as an error and just download these again. Thus I propose you edit your disk space settings in the Computing preferences to suit your needs, and let BOINC (client and server) do the file handling.

BM

Edit:
I'm puzzled by the following files still being on your computer:

einsteinbinary_ABP2_3.03_graphics_windows_intelx86.exe
einsteinbinary_ABP2_3.08_windows_intelx86.exe
einsteinbinary_BRP3_1.00_graphics_windows_intelx86.exe
einstein_S5GC1_3.02_windows_intelx86.exe
einstein_S5GC1_3.02_windows_intelx86__S5GCESSE.exe
einstein_S5GCE_3.04_windows_intelx86__S5GCESSE.exe
einstein_S5R6_3.01_windows_intelx86__S5R6sse.exe

These belong to old applications that have been obsolete for years. It looks like the BOINC Core Client isn't very good at cleaning up application files, which is a separate but minor problem. These files can safely be deleted, but that won't give you much space.

Edit#2:
Note that the new BRP4 data files (p2030_*.bin4) are 50% smaller than the ones previously sent for this search (p2030_*.binary).

BM

Professor Ray
Professor Ray
Joined: 22 Feb 05
Posts: 46
Credit: 12529709
RAC: 1053

Well, it looks like there's

Well, it looks like there's nearly 77,400 S6Bucket WU's still remaining. Given my free space-contstraints, no sense in doing anything until ALL S6Bucket WU's have gone the way of the dodo.

I understand that S6LV1 & S6Bucket WU's process the same GW 'search files'. So if my preferences allow both GWS6GC or GWS6LV applications - as there's still a lot of WU's available - will either application process the same 'search files'?

Moreover, it appears that there's still ~3000 FGRP1 WU's to cruch. Do those WU's also process the same 'search files' pertainent the S6* based applications?

Succinctly: I desire to avoid downloading any additional 'search files', but I'm happy running multiple applications.

tolafoph
tolafoph
Joined: 14 Sep 07
Posts: 122
Credit: 74659937
RAC: 0

RE: Moreover, it appears

Quote:

Moreover, it appears that there's still ~3000 FGRP1 WU's to cruch.

On the server status page you find the FGRP1 search progress and there are still 1,700,000 tasks to finish. What you mean are just the tasks to send.

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4312
Credit: 250730726
RAC: 35710

These files are general

These files are general project files:

Quote:

eah_slide_02.png
eah_slide_05.png
eah_slide_07.png
eah_slide_08.png
eah_slide_11.png
eah_slide_12.png
eah_slide_13.png
einstein_icon.png
stat_icon
slideshow_einsteinbinary_BRP4_00
slideshow_einsteinbinary_BRP4_01
slideshow_einsteinbinary_BRP4_02
slideshow_einsteinbinary_BRP4_03
slideshow_einsteinbinary_BRP4_04
slideshow_einstein_S6Bucket_00
slideshow_einstein_S6Bucket_01
slideshow_einstein_S6Bucket_02
slideshow_einstein_S6Bucket_03
slideshow_einstein_S6Bucket_04
symbols\ (~20.6MB folder)


These files are related to the Gravitational Wave searches S6Bucket and S6LV1:

Quote:

sun_05_09
sun_09_11
earth_05_09
earth_09_11
einstein_S6Bucket_1.02_windows_intelx86__SSE.exe
h1_0242.80_S6GC1
h1_0242.85_S6GC1
h1_0242.90_S6GC1
h1_0242.95_S6GC1
h1_0243.00_S6GC1
h1_0243.05_S6GC1
h1_0287.75_S6GC1
h1_0287.80_S6GC1
h1_0287.85_S6GC1
h1_0287.90_S6GC1
h1_0287.95_S6GC1
h1_0288.00_S6GC1
h1_0393.90_S6GC1
h1_0393.95_S6GC1
h1_0394.00_S6GC1
h1_0394.05_S6GC1
h1_0394.10_S6GC1
h1_0394.15_S6GC1
h1_0394.20_S6GC1
h1_0394.25_S6GC1
h1_0400.65_S6GC1
h1_0400.70_S6GC1
h1_0400.75_S6GC1
h1_0400.80_S6GC1
h1_0400.85_S6GC1
h1_0400.90_S6GC1
h1_0447.75_S6GC1
h1_0447.80_S6GC1
h1_0447.85_S6GC1
h1_0447.90_S6GC1
h1_0447.95_S6GC1
h1_0448.00_S6GC1
l1_0242.80_S6GC1
l1_0242.85_S6GC1
l1_0242.90_S6GC1
l1_0242.95_S6GC1
l1_0243.00_S6GC1
l1_0243.05_S6GC1
l1_0287.75_S6GC1
l1_0287.80_S6GC1
l1_0287.85_S6GC1
l1_0287.90_S6GC1
l1_0287.95_S6GC1
l1_0288.00_S6GC1
l1_0393.90_S6GC1
l1_0393.95_S6GC1
l1_0394.00_S6GC1
l1_0394.05_S6GC1
l1_0394.10_S6GC1
l1_0394.15_S6GC1
l1_0394.20_S6GC1
l1_0394.25_S6GC1
l1_0400.65_S6GC1
l1_0400.70_S6GC1
l1_0400.75_S6GC1
l1_0400.80_S6GC1
l1_0400.85_S6GC1
l1_0400.90_S6GC1
l1_0447.75_S6GC1
l1_0447.80_S6GC1
l1_0447.85_S6GC1
l1_0447.90_S6GC1
l1_0447.95_S6GC1
l1_0448.00_S6GC1


These files are related to the Binary Radio Pulsar search (currently BRP4):

Quote:

einsteinbinary_BRP4_1.00_graphics_windows_intelx86.exe
einsteinbinary_BRP4_1.00_windows_intelx86__BRP3SSE.exe
einsteinbinary_BRP4_1.22_windows_intelx86__BRP4SSE.exe
p2030.20111003.G37.79-00.04.C.b4s0g0.00000.zap
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1448.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1449.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1450.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1451.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1452.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1453.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1454.bin4
p2030.20111003.G37.79-00.04.C.b4s0g0.00000_1455.bin4
stochastic_full.bank


These files are related to the Fermi-LAT GAmma-Ray Pulsar search (FGRP1):

Quote:

hsgamma_FGRP1_0.23_windows_intelx86.exe
JPLEPH.405
LATeah2314A.dat
skygrid_LATeah2314A_0096.0.dat

The files ending in "_S6GC1" will stay on your computer as long as there is S6LV1 or S6Bucket work available that uses these files. Our scheduler should try to send you S6Bucket or S6LV1 tasks that use the files you already have as long as possible, in order to save you from downloading additional files as long as possible.

As for the other two apps, each set of files (appart from the application binaries) are required for a single tasks and will get deleted when this task is finished on your computer. The only exception is "JPLEPH.405". This file will stay on your computer as long as you can get FGRP1 tasks, so you don't have to download it over and over again.

hth,

BM

BM

Professor Ray
Professor Ray
Joined: 22 Feb 05
Posts: 46
Credit: 12529709
RAC: 1053

Thanx for splainin that: I

Thanx for splainin that: I gots it now. I re-enabled FGRP1 and promptly received a WU; space utilized by FGRP1 tasks are trivial. Ergo, I realize that I could do one of three things:

  • - process Gravitational Wave tasks exclusively - process Binary Pulsar tasks exlusively
    - process Gamma Ray Pular and either GW or BP tasks

I've decided that the latter w/respect to GW tasks inclusively suits for the time being. Hopefully that won't be an issue as it pertains to CPU applications only.

Furthermore, its not often that one gets to use ergo in a printed sentence (let alone colloquial conversation); my works done here for the day (chaos, confusion and panic reign supreme). I'm going home now. LOL.

Professor Ray
Professor Ray
Joined: 22 Feb 05
Posts: 46
Credit: 12529709
RAC: 1053

RE: ...einsteinbinary_ABP2

Quote:


...einsteinbinary_ABP2_3.03_graphics_windows_intelx86.exe
einsteinbinary_ABP2_3.08_windows_intelx86.exe
einsteinbinary_BRP3_1.00_graphics_windows_intelx86.exe
einstein_S5GC1_3.02_windows_intelx86.exe
einstein_S5GC1_3.02_windows_intelx86__S5GCESSE.exe
einstein_S5GCE_3.04_windows_intelx86__S5GCESSE.exe
einstein_S5R6_3.01_windows_intelx86__S5R6sse.exe

These belong to old applications that have been obsolete for years. It looks like the BOINC Core Client isn't very good at cleaning up application files, which is a separate but minor problem. These files can safely be deleted, but that won't give you much space...

So poofing these files in Windows Explorer, and then hacking out any references to them in client_state.xml won't cause any lasting damage - like zombies - if they're necessary for some task, they'll be servered down again.

Those files would increase free-space by a factor of 1.13; I'll take it. If nothing else: IE8 temp internet files can utilize that free-space. This is all very utilitarian given my use of Ultimate Defrag; allowing me to specify files that are relegated to outter tracks (frequent access) and those relegated to inner tracks (infrequent access) - the sort order for either regions, i.e., outter tracks sorted by modification frequency ascending (most modified files on inner tracks of high performance region) and "archive" region sorted ascending by access frequency) - with free-space split on either side of the region allocated for directory or NTFS meta-files and the page-file.

What about this:

  • einstein_S5R6_3.01_graphics_windows_intelx86.exe

You didn't say it was hackable; I left it in situ.

Professor Ray
Professor Ray
Joined: 22 Feb 05
Posts: 46
Credit: 12529709
RAC: 1053

3/23/2012 8:44:36 PM |

3/23/2012 8:44:36 PM | Einstein@Home | [error] State file error: missing application file einstein_S5R6_3.01_windows_intelx86__S5R6sse.exe
3/23/2012 8:44:36 PM | Einstein@Home | [error] State file error: missing application file einsteinbinary_ABP2_3.08_windows_intelx86.exe
3/23/2012 8:44:36 PM | Einstein@Home | [error] State file error: missing application file einstein_S5GCE_3.04_windows_intelx86__S5GCESSE.exe
3/23/2012 8:44:36 PM | Einstein@Home | [error] State file error: missing application file einstein_S5GC1_3.02_windows_intelx86.exe
3/23/2012 8:44:36 PM | Einstein@Home | [error] State file error: missing application file einstein_S5GC1_3.02_windows_intelx86__S5GCESSE.exe
3/23/2012 8:44:36 PM | Einstein@Home | [error] State file error: missing application file einsteinbinary_BRP3_1.00_graphics_windows_intelx86.exe
3/23/2012 8:44:36 PM | Einstein@Home | [error] State file error: missing application file einsteinbinary_BRP3_1.00_graphics_windows_intelx86.exe

3/23/2012 8:44:37 PM | Einstein@Home | [error] Signature verification failed for einstein_S6Bucket_1.02_windows_intelx86__SSE.exe

3/23/2012 8:44:38 PM | Einstein@Home | Computation for task h1_0441.05_S6GC1__1_S6BucketA_1 finished
3/23/2012 8:44:38 PM | Einstein@Home | Output file h1_0441.05_S6GC1__1_S6BucketA_1_0 for task h1_0441.05_S6GC1__1_S6BucketA_1 absent
3/23/2012 8:44:38 PM | Einstein@Home | [error] MD5 check failed for JPLEPH.405
3/23/2012 8:44:38 PM | Einstein@Home | [error] expected d6ce12bacd2a81a56423f5f238ba84eb, got 4d57afd859e503844286e3491ecc9dec
3/23/2012 8:44:39 PM | Einstein@Home | Computation for task h1_0443.00_S6GC1__68_S6BucketA_1 finished
3/23/2012 8:44:39 PM | Einstein@Home | Output file h1_0443.00_S6GC1__68_S6BucketA_1_0 for task h1_0443.00_S6GC1__68_S6BucketA_1 absent
3/23/2012 8:44:39 PM | Einstein@Home | Computation for task LATeah2350A_96.0_300_-1.8e-11_0 finished
3/23/2012 8:44:39 PM | Einstein@Home | Output file LATeah2350A_96.0_300_-1.8e-11_0_0 for task LATeah2350A_96.0_300_-1.8e-11_0 absent
3/23/2012 8:44:39 PM | Einstein@Home | Output file LATeah2350A_96.0_300_-1.8e-11_0_1 for task LATeah2350A_96.0_300_-1.8e-11_0 absent

[Hmmmm. That didn't go well.]

3/23/2012 8:44:39 PM | SETI@home | Restarting task 17my11aa.11805.380541.3.10.190_2 using setiathome_enhanced version 603
3/23/2012 8:44:46 PM | SETI@home | Sending scheduler request: To fetch work.
3/23/2012 8:44:46 PM | SETI@home | Requesting new tasks for CPU
3/23/2012 8:44:53 PM | SETI@home | Scheduler request completed: got 3 new tasks
3/23/2012 8:44:55 PM | SETI@home | Started download of 09jn11ad.31450.5388.16.10.155
3/23/2012 8:44:55 PM | SETI@home | Started download of 09jn11ad.31194.5388.15.10.180
3/23/2012 8:45:10 PM | SETI@home | Finished download of 09jn11ad.31194.5388.15.10.180
3/23/2012 8:45:10 PM | SETI@home | Started download of 09jn11ad.31450.5388.16.10.159
3/23/2012 8:45:17 PM | SETI@home | Finished download of 09jn11ad.31450.5388.16.10.155

Bikeman (Heinz-Bernd Eggenstein)
Bikeman (Heinz-...
Moderator
Joined: 28 Aug 06
Posts: 3522
Credit: 735619516
RAC: 1280250

Hi! To repair,"reset" the

Hi!

To repair,"reset" the project in the BOINC manager if BOINC wasn't able to recover by itself.

HBE

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.