OpenCL error: CL_MEM_OBJECT_ALLOCATION_FAILURE

Greg_BE
Greg_BE
Joined: 15 Aug 08
Posts: 90
Credit: 106143546
RAC: 27674
Topic 229845

[url] https://einsteinathome.org/workunit/742775372[/url]

I checked the other 2 systems that also failed to complete this task, they got the same thing

0.2023-07-21 22:12:22.8206 (21312) [normal]: CG:36521827 FG:500000  f1dotmin_fg:-2.773529411765e-009 df1dot_fg:2.941176470588e-012 f2dotmin_fg:0 df2dot_fg:0 f3dotmin_fg:0 df3dot_fg:1
XLAL Error - XLALOpenCLExecuteKernel (/home/jenkins/workspace/workspace/EaH-GW-OpenCL-Testing/SLAVE/MinGW6.3/TARGET/windows-x64/EinsteinAtHome/source/lalsuite/lalpulsar/lib/GPUUtils/OpenCLUtils.c:652): Enqueue OpenCL kernel failed with OpenCL error: CL_MEM_OBJECT_ALLOCATION_FAILURE

This was another computer

0.2023-07-23 20:30:09.0720 (15752) [normal]: CG:36521827 FG:500000  f1dotmin_fg:-2.773529411765e-009 df1dot_fg:2.941176470588e-012 f2dotmin_fg:0 df2dot_fg:0 f3dotmin_fg:0 df3dot_fg:1
XLAL Error - XLALOpenCLExecuteKernel (/home/jenkins/workspace/workspace/EaH-GW-OpenCL-Testing/SLAVE/MinGW6.3/TARGET/windows-x64/EinsteinAtHome/source/lalsuite/lalpulsar/lib/GPUUtils/OpenCLUtils.c:652): Enqueue OpenCL kernel failed with OpenCL error: CL_MEM_OBJECT_ALLOCATION_FAILURE

This is mine

There is a whole page of text about how this task ran...you can read through it and the others and see if there is anything on our system going bad. Before the above text we get:

DEPRECATION WARNING: program has invoked obsolete function InitDopplerSkyScan and 

Internal function call failed: Generic failure

 

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3945
Credit: 46592792642
RAC: 64189201

The problem is not enough

The problem is not enough VRAM. These tasks need right around 4GB. All of your errors are on the 1050Ti which only has 4GB. 4GB GPUs do not have enough memory to run these GW tasks 
 

One solution for you is to disable processing of Gravitational Wave type tasks. Go into your project preferences for the appropriate venue and uncheck the All-Sky tasks as your GPU cannot do them. But you can process BRP7 MeerKAT and Gamma Ray FGRPB1G. 
 

or exclude your second GPU (the 1050Ti) from running GW tasks with an appropriate exclude statement in your cc_config. 

_________________________________________________________________________

Greg_BE
Greg_BE
Joined: 15 Aug 08
Posts: 90
Credit: 106143546
RAC: 27674

ahh! ok..thanks 

ahh! ok..thanks

is this a card problem or something due to running Folding at home on the same card?

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3945
Credit: 46592792642
RAC: 64189201

I update my post a bit. But

I update my post a bit. But it’s a problem with the 1050Ti not having enough VRAM. There are many posts just like yours about the same topic and most are with people trying to use the same GPU. 

_________________________________________________________________________

Greg_BE
Greg_BE
Joined: 15 Aug 08
Posts: 90
Credit: 106143546
RAC: 27674

ahh! ok...so that explains

ahh! ok...so that explains why I just completed one with no problem...must have been the 1080
well I will have to look up how to just use the 1080 then. I think I have something already written for that.

Copied Mikey's script from another thread...so now everything goes to the 1080.

Sure takes a lot of tweaking to get this system to do what I want it to do. But I got it dialed in now.
 

mikey
mikey
Joined: 22 Jan 05
Posts: 12676
Credit: 1839075911
RAC: 3987

Greg_BE wrote:ahh! ok...so

Greg_BE wrote:

ahh! ok...so that explains why I just completed one with no problem...must have been the 1080
well I will have to look up how to just use the 1080 then. I think I have something already written for that.

Copied Mikey's script from another thread...so now everything goes to the 1080.

Sure takes a lot of tweaking to get this system to do what I want it to do. But I got it dialed in now. 

WOO HOO!!! 

You should try running a mining gpu card that has no display ports so you have to use a separate gpu in the pc or remote into the pc every time you want to even check on things, trying to remember to exclude the 2nd gpu is a pain in the butt with all the different Boinc Projects with gpu tasks!!! 

Thank you Ian&Steve for that learning experience...LOVE the mining gpu HATE the excluding part!!

Greg_BE
Greg_BE
Joined: 15 Aug 08
Posts: 90
Credit: 106143546
RAC: 27674

Dont have the gold bars to

Dont have the gold bars to pay for that kind of device.

I got lucky with the 1080 coming out of a server room at a graphics company.
Haven't found anything good since then.
'fun money' is all tied up in a Sonos sound system right now. When that is paid then I can start building a graphics card fund again.

Greg_BE
Greg_BE
Joined: 15 Aug 08
Posts: 90
Credit: 106143546
RAC: 27674

The 1080 I think can't

The 1080 I think can't process All Sky and Folding at home at the same time with the onboard memory.

I had both going and the All Sky errored out the same way again.

 

Whats the next up card from a 1080 that is within a reasonable price? 1660? And what is the difference between TI models and plain models? Is a TI worth the money?

Keith Myers
Keith Myers
Joined: 11 Feb 11
Posts: 4963
Credit: 18697877860
RAC: 6218505

If the 1080 with 8GB of

If the 1080 with 8GB of memory doesn't cut it, then a 1660 with only 6GB memory simply won't either.

You need a card with 12GB or more of memory.  Something like the 12GB 3060 or one of the 4070 variants.

 

Ben Scott
Ben Scott
Joined: 30 Mar 20
Posts: 53
Credit: 1580990094
RAC: 4900059

I am currently running All

I am currently running All Sky GW three at a time on a 12GB card. The secret is to not run *any* graphics on the card, not even the login screen. The GW tasks need all 4GB to run. With Linux shutting off the graphics is easy but with windows you will need a separate card for windows to run its graphics on and then tell Windows not to touch the other card.

Greg_BE
Greg_BE
Joined: 15 Aug 08
Posts: 90
Credit: 106143546
RAC: 27674

Oh I see whats going on...it

Oh I see whats going on...it ignored my script to force it to the 1080. It's going to the 1050 again.
Well I'll fight with that again Friday afternoon.

 

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.