Fetching too many tasks

Forums › Problems and Bug Reports

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3965
Credit: 47225062642
RAC: 65383384

Yeah but he wasn’t originally

27 Apr 2022 13:59:50 UTC
Message 195475
(moderation:
    )

    Yeah but he wasn’t originally using project max concurrent so that’s likely not the problem anyway. 
     

    Neal, with your cache set to 0.05 days, and you manually reducing the cache to some small level, what does BOINC request for work? Post the event log entries when Einstein is doing a schedule request 

    _________________________________________________________________________

    Harri Liljeroos
    Harri Liljeroos
    Joined: 10 Dec 05
    Posts: 4366
    Credit: 3220083749
    RAC: 2036961

    I think that the

    27 Apr 2022 15:49:00 UTC
    Message 195476
    (moderation:
      )

      I think that the <max_concurrent> in the app section of app_config.xml will have the same effect.

      Keith Myers
      Keith Myers
      Joined: 11 Feb 11
      Posts: 4970
      Credit: 18772785955
      RAC: 7199799

      Harri Liljeroos wrote: I was

      27 Apr 2022 16:18:14 UTC
      Message 195477 in response to message 195474
      (moderation:
        )

        Harri Liljeroos wrote:

        I was under impression that the latest version 7.16.20 was supposed to have the fix for this but I have not tested that version myself. (Wrong version shown on Release notes page in boinc.berkeley.edu)

        No. 7.16.20 was released in October.  The patch for project max concurrent didn't get merged until December.

        client: fix work-fetch logic when max concurrent limits are used

         

        Neal Burns
        Neal Burns
        Joined: 19 Feb 22
        Posts: 25
        Credit: 213291419
        RAC: 188

        Harri Liljeroos wrote: I was

        27 Apr 2022 20:08:11 UTC
        Message 195489 in response to message 195474
        (moderation:
          )

          Harri Liljeroos wrote:

          I was under impression that the latest version 7.16.20 was supposed to have the fix for this but I have not tested that version myself. (Wrong version shown on Release notes page in boinc.berkeley.edu)

           

          I'm already running 7.16.20, since the end of February.

           

          Keith Myers
          Keith Myers
          Joined: 11 Feb 11
          Posts: 4970
          Credit: 18772785955
          RAC: 7199799

          7.16.20 doesn't have the fix

          27 Apr 2022 20:15:08 UTC
          Message 195490 in response to message 195489
          (moderation:
            )

            7.16.20 doesn't have the fix for project max concurrent. Will have to wait some more for a newer build that incorporates the fix.

            Or build the client yourself from the current Master branch which incorporates the fix.

             

            Neal Burns
            Neal Burns
            Joined: 19 Feb 22
            Posts: 25
            Credit: 213291419
            RAC: 188

            Ian&Steve C. wrote:Yeah but

            27 Apr 2022 20:58:54 UTC
            Message 195491 in response to message 195475
            (moderation:
              )

              Ian&Steve C. wrote:

              Yeah but he wasn’t originally using project max concurrent so that’s likely not the problem anyway. 
               

              Neal, with your cache set to 0.05 days, and you manually reducing the cache to some small level, what does BOINC request for work? Post the event log entries when Einstein is doing a schedule request 

               

              I don't know if these logs are going to help. They only go back to early this morning, and the tasks had reached a steady state by then, so the number was no longer growing. I also set the resource share to 0 at some point. I can't recall when.

              In this sample, it seems to be receiving about the same number that it's sending:

              4/27/2022 1:46:08 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_74124_0_1
4/27/2022 1:46:09 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_74124_0_0
4/27/2022 1:46:09 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_74124_0_1
4/27/2022 1:53:22 AM | Einstein@Home | Computation for task LATeah3012L07_844.0_0_0.0_136746_1 finished
4/27/2022 1:53:22 AM | Einstein@Home | Starting task LATeah3012L07_844.0_0_0.0_135468_1
4/27/2022 1:53:24 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_136746_1_0
4/27/2022 1:53:24 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_136746_1_1
4/27/2022 1:53:25 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_136746_1_0
4/27/2022 1:53:26 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_136746_1_1
4/27/2022 2:00:38 AM | Einstein@Home | Computation for task LATeah3012L07_844.0_0_0.0_135468_1 finished
4/27/2022 2:00:38 AM | Einstein@Home | Starting task LATeah3012L07_844.0_0_0.0_139941_0
4/27/2022 2:00:40 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_135468_1_0
4/27/2022 2:00:40 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_135468_1_1
4/27/2022 2:00:41 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_135468_1_0
4/27/2022 2:00:41 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_135468_1_1
4/27/2022 2:03:13 AM | Einstein@Home | Computation for task LATeah3012L07_844.0_0_0.0_75402_0 finished
4/27/2022 2:03:13 AM | Einstein@Home | Starting task LATeah3012L07_844.0_0_0.0_137385_0
4/27/2022 2:03:15 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_75402_0_0
4/27/2022 2:03:15 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_75402_0_1
4/27/2022 2:03:16 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_75402_0_0
4/27/2022 2:03:16 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_75402_0_1
4/27/2022 2:03:18 AM | Einstein@Home | Sending scheduler request: To fetch work.
4/27/2022 2:03:18 AM | Einstein@Home | Reporting 5 completed tasks
4/27/2022 2:03:18 AM | Einstein@Home | Requesting new tasks for NVIDIA GPU
4/27/2022 2:03:21 AM | Einstein@Home | Scheduler request completed: got 4 new tasks
4/27/2022 2:03:21 AM | Einstein@Home | Project requested delay of 60 seconds
4/27/2022 2:03:23 AM | Einstein@Home | Started download of templates_LATeah3012L07_0852_17495820.dat
4/27/2022 2:03:23 AM | Einstein@Home | Started download of templates_LATeah3012L07_0852_17496459.dat
4/27/2022 2:03:25 AM | Einstein@Home | Finished download of templates_LATeah3012L07_0852_17495820.dat
4/27/2022 2:03:25 AM | Einstein@Home | Finished download of templates_LATeah3012L07_0852_17496459.dat
4/27/2022 2:03:25 AM | Einstein@Home | Started download of templates_LATeah3012L07_0852_17494542.dat
4/27/2022 2:03:25 AM | Einstein@Home | Started download of templates_LATeah3012L07_0852_17495181.dat
4/27/2022 2:03:26 AM | Einstein@Home | Finished download of templates_LATeah3012L07_0852_17494542.dat
4/27/2022 2:03:26 AM | Einstein@Home | Finished download of templates_LATeah3012L07_0852_17495181.dat
4/27/2022 2:07:55 AM | Einstein@Home | Computation for task LATeah3012L07_844.0_0_0.0_139941_0 finished
4/27/2022 2:07:55 AM | Einstein@Home | Starting task LATeah3012L07_844.0_0_0.0_136107_1
4/27/2022 2:07:56 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_139941_0_0
4/27/2022 2:07:56 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_139941_0_1
4/27/2022 2:07:58 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_139941_0_0
4/27/2022 2:07:58 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_139941_0_1
4/27/2022 2:15:11 AM | Einstein@Home | Computation for task LATeah3012L07_844.0_0_0.0_136107_1 finished
4/27/2022 2:15:11 AM | Einstein@Home | Starting task LATeah3012L07_844.0_0_0.0_186588_1
4/27/2022 2:15:13 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_136107_1_0
4/27/2022 2:15:13 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_136107_1_1
4/27/2022 2:15:15 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_136107_1_0
4/27/2022 2:15:15 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_136107_1_1
4/27/2022 2:22:27 AM | Einstein@Home | Computation for task LATeah3012L07_844.0_0_0.0_186588_1 finished
4/27/2022 2:22:27 AM | Einstein@Home | Starting task LATeah3012L07_844.0_0_0.0_187227_0
4/27/2022 2:22:29 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_186588_1_0
4/27/2022 2:22:29 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_186588_1_1
4/27/2022 2:22:31 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_186588_1_0
4/27/2022 2:22:31 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_186588_1_1
4/27/2022 2:27:04 AM | Einstein@Home | Computation for task LATeah3012L07_844.0_0_0.0_137385_0 finished
4/27/2022 2:27:04 AM | Einstein@Home | Starting task LATeah3012L07_844.0_0_0.0_187866_1
4/27/2022 2:27:07 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_137385_0_0
4/27/2022 2:27:07 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_137385_0_1
4/27/2022 2:27:08 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_137385_0_0
4/27/2022 2:27:08 AM | Einstein@Home | Finished upload of LATeah3012L07_844.0_0_0.0_137385_0_1
4/27/2022 2:27:09 AM | Einstein@Home | Sending scheduler request: To fetch work.
4/27/2022 2:27:09 AM | Einstein@Home | Reporting 4 completed tasks
4/27/2022 2:27:09 AM | Einstein@Home | Requesting new tasks for NVIDIA GPU
4/27/2022 2:27:11 AM | Einstein@Home | Scheduler request completed: got 4 new tasks
4/27/2022 2:27:11 AM | Einstein@Home | Project requested delay of 60 seconds
4/27/2022 2:27:13 AM | Einstein@Home | Started download of templates_LATeah3012L07_0852_18542502.dat
4/27/2022 2:27:13 AM | Einstein@Home | Started download of templates_LATeah3012L07_0852_18543141.dat
4/27/2022 2:27:15 AM | Einstein@Home | Finished download of templates_LATeah3012L07_0852_18542502.dat
4/27/2022 2:27:15 AM | Einstein@Home | Finished download of templates_LATeah3012L07_0852_18543141.dat
4/27/2022 2:27:15 AM | Einstein@Home | Started download of templates_LATeah3012L07_0852_18543780.dat
4/27/2022 2:27:15 AM | Einstein@Home | Started download of templates_LATeah3012L07_0852_18544419.dat
4/27/2022 2:27:16 AM | Einstein@Home | Finished download of templates_LATeah3012L07_0852_18544419.dat
4/27/2022 2:27:17 AM | Einstein@Home | Finished download of templates_LATeah3012L07_0852_18543780.dat
4/27/2022 2:29:42 AM | Einstein@Home | Computation for task LATeah3012L07_844.0_0_0.0_187227_0 finished
4/27/2022 2:29:42 AM | Einstein@Home | Starting task LATeah3012L07_844.0_0_0.0_239625_0
4/27/2022 2:29:44 AM | Einstein@Home | Started upload of LATeah3012L07_844.0_0_0.0_187227_0_0

               

              This sample is from later, where it has stopped requesting additional tasks, maybe because I set the resource share to 0:

              4/27/2022 6:38:04 AM | Einstein@Home | Sending scheduler request: To report completed tasks.
4/27/2022 6:38:04 AM | Einstein@Home | Reporting 3 completed tasks
4/27/2022 6:38:04 AM | Einstein@Home | Not requesting tasks: don't need (CPU: ; NVIDIA GPU: job cache full)
4/27/2022 6:38:07 AM | Einstein@Home | Scheduler request completed
4/27/2022 6:38:07 AM | Einstein@Home | Project requested delay of 60 seconds
4/27/2022 6:46:37 AM | Einstein@Home | Computation for task LATeah3012L06_740.0_0_0.0_5158008_2 finished
4/27/2022 6:46:38 AM | Einstein@Home | Starting task LATeah3012L06_740.0_0_0.0_5300505_2
4/27/2022 6:46:40 AM | Einstein@Home | Started upload of LATeah3012L06_740.0_0_0.0_5158008_2_0
4/27/2022 6:46:40 AM | Einstein@Home | Started upload of LATeah3012L06_740.0_0_0.0_5158008_2_1
4/27/2022 6:46:42 AM | Einstein@Home | Finished upload of LATeah3012L06_740.0_0_0.0_5158008_2_0
4/27/2022 6:46:42 AM | Einstein@Home | Finished upload of LATeah3012L06_740.0_0_0.0_5158008_2_1
4/27/2022 7:09:11 AM | Einstein@Home | Computation for task LATeah3012L06_740.0_0_0.0_5300505_2 finished
4/27/2022 7:09:11 AM | Einstein@Home | Starting task LATeah3012L06_740.0_0_0.0_5157369_2
4/27/2022 7:09:13 AM | Einstein@Home | Started upload of LATeah3012L06_740.0_0_0.0_5300505_2_0
4/27/2022 7:09:13 AM | Einstein@Home | Started upload of LATeah3012L06_740.0_0_0.0_5300505_2_1
4/27/2022 7:09:15 AM | Einstein@Home | Finished upload of LATeah3012L06_740.0_0_0.0_5300505_2_0
4/27/2022 7:09:15 AM | Einstein@Home | Finished upload of LATeah3012L06_740.0_0_0.0_5300505_2_1
4/27/2022 7:31:44 AM | Einstein@Home | Computation for task LATeah3012L06_740.0_0_0.0_5157369_2 finished
4/27/2022 7:31:44 AM | Einstein@Home | Starting task LATeah3012L06_740.0_0_0.0_5287086_2
4/27/2022 7:31:46 AM | Einstein@Home | Started upload of LATeah3012L06_740.0_0_0.0_5157369_2_0
4/27/2022 7:31:46 AM | Einstein@Home | Started upload of LATeah3012L06_740.0_0_0.0_5157369_2_1
4/27/2022 7:31:47 AM | Einstein@Home | Finished upload of LATeah3012L06_740.0_0_0.0_5157369_2_0
4/27/2022 7:31:47 AM | Einstein@Home | Finished upload of LATeah3012L06_740.0_0_0.0_5157369_2_1
4/27/2022 7:47:17 AM | Einstein@Home | Sending scheduler request: To report completed tasks.
4/27/2022 7:47:17 AM | Einstein@Home | Reporting 3 completed tasks
4/27/2022 7:47:17 AM | Einstein@Home | Not requesting tasks: don't need (CPU: ; NVIDIA GPU: job cache full)
4/27/2022 7:47:19 AM | Einstein@Home | Scheduler request completed
4/27/2022 7:47:19 AM | Einstein@Home | Project requested delay of 60 seconds
4/27/2022 7:54:19 AM | Einstein@Home | Computation for task LATeah3012L06_740.0_0_0.0_5287086_2 finished
4/27/2022 7:54:19 AM | Einstein@Home | Starting task LATeah3012L06_740.0_0_0.0_5138199_2
4/27/2022 7:54:21 AM | Einstein@Home | Started upload of LATeah3012L06_740.0_0_0.0_5287086_2_0
4/27/2022 7:54:21 AM | Einstein@Home | Started upload of LATeah3012L06_740.0_0_0.0_5287086_2_1
4/27/2022 7:54:22 AM | Einstein@Home | Finished upload of LATeah3012L06_740.0_0_0.0_5287086_2_0
4/27/2022 7:54:22 AM | Einstein@Home | Finished upload of LATeah3012L06_740.0_0_0.0_5287086_2_1
4/27/2022 8:16:52 AM | Einstein@Home | Computation for task LATeah3012L06_740.0_0_0.0_5138199_2 finished
4/27/2022 8:16:52 AM | Einstein@Home | Starting task LATeah3012L07_844.0_0_0.0_508644_0
4/27/2022 8:16:55 AM | Einstein@Home | Started upload of LATeah3012L06_740.0_0_0.0_5138199_2_0
4/27/2022 8:16:55 AM | Einstein@Home | Started upload of LATeah3012L06_740.0_0_0.0_5138199_2_1
4/27/2022 8:16:57 AM | Einstein@Home | Finished upload of LATeah3012L06_740.0_0_0.0_5138199_2_0
4/27/2022 8:16:57 AM | Einstein@Home | Finished upload of LATeah3012L06_740.0_0_0.0_5138199_2_1
4/27/2022 8:40:40 AM | Einstein@Home | Computation for task LATeah3012L07_844.0_0_0.0_508644_0 finished

              At some point this morning I set the project as "No new work", so there is no significance to the logs after that.

              By the way, what do you suggest I do with all of the excess tasks that have accumulated? Should I abort them and get fresh ones, or work through the backlog until they are about to reach the deadline? Do they lose value while sitting in the queue for days?

              Thanks.

              PS. I had looked in the logs when it was still growing, and here's what I saw it doing: Every time it sent any completed tasks, it would download a larger number, like maybe 2x. So it grew a little each on each update. It finally stopped when it had around 1000. There is probably some significance to the number 1000.

               

              Ian&Steve C.
              Ian&Steve C.
              Joined: 19 Jan 20
              Posts: 3965
              Credit: 47225062642
              RAC: 65383384

              you don't have to abort them.

              27 Apr 2022 21:26:13 UTC
              Message 195493
              (moderation:
                )

                you don't have to abort them. you can just hold on to them and crunch them. you will complete them all before deadline easily if you're running 24/7. they do not lose value as long as you submit them.

                _________________________________________________________________________

                Keith Myers
                Keith Myers
                Joined: 11 Feb 11
                Posts: 4970
                Credit: 18772785955
                RAC: 7199799

                Neal Burns wrote: So it grew

                27 Apr 2022 22:12:25 UTC
                Message 195495 in response to message 195491
                (moderation:
                  )

                  Neal Burns wrote:

                  So it grew a little each on each update. It finally stopped when it had around 1000. There is probably some significance to the number 1000.

                  Yes, the client and project max allowed is 1000 tasks. That is the default BOINC client and server limit unless overridden by the project admins or running a custom client.

                   

                  Neal Burns
                  Neal Burns
                  Joined: 19 Feb 22
                  Posts: 25
                  Credit: 213291419
                  RAC: 188

                  Ian&Steve C. wrote: you

                  27 Apr 2022 22:41:42 UTC
                  Message 195499 in response to message 195493
                  (moderation:
                    )

                    Ian&Steve C. wrote:

                    you don't have to abort them. you can just hold on to them and crunch them. you will complete them all before deadline easily if you're running 24/7. they do not lose value as long as you submit them.

                     

                    Thanks. I think that with Rosetta@Home, there were people waiting for the results, so the turnaround time was important.

                    Neal Burns
                    Neal Burns
                    Joined: 19 Feb 22
                    Posts: 25
                    Credit: 213291419
                    RAC: 188

                    Keith Myers wrote: Neal

                    27 Apr 2022 22:43:57 UTC
                    Message 195500 in response to message 195495
                    (moderation:
                      )

                      Keith Myers wrote:

                      Neal Burns wrote:

                      So it grew a little each on each update. It finally stopped when it had around 1000. There is probably some significance to the number 1000.

                      Yes, the client and project max allowed is 1000 tasks. That is the default BOINC client and server limit unless overridden by the project admins or running a custom client.

                      That makes a lot of sense.

                      Comment viewing options

                      Select your preferred way to display the comments and click "Save settings" to activate your changes.

                      Forums › Problems and Bug Reports