[lsst-dm-stack-users] stack build can be *very* memory hungry -- default to fewer NCORES?

[Simon Krughoff]

I think there was a desire not to have to modify eups code, so setting
EUPSPKG_SCRIPTS is probably the preferred route.


On Wed, Jun 25, 2014 at 10:20 AM, Dustin Lang <dstndstn at gmail.com> wrote:

>
> Aha!, that seems to work to add to $EUPS_DIR/lib/eupspkg.sh also.
>
> Documentation fix?
>
> --dstn
>
> On Wed, 25 Jun 2014, Simon Krughoff wrote:
>
> > To follow up, I was able to use the EUPSPKG_SCRIPTS to point to a shell
> script with just one line:export NJOBS=1
> >
> > Simon
> >
> >
> > On Wed, Jun 25, 2014 at 9:47 AM, Kian-Tat Lim <ktl at slac.stanford.edu>
> wrote:
> >       Dustin,
> >
> >       > On my Mac OSX 10.8 laptop with 4 cores and 8 GB of memory, the
> machine
> >       > becomes nearly unusable during the afw build.  I would think
> this would be
> >       > a fairly standard target machine for our users, so I would
> suggest that we
> >       > might want to highlight (and fix the errors in) the description
> of how to
> >       > make the build use fewer cores.  Or perhaps just crank down the
> default to
> >       > not fully max out the number of cores.
> >
> >         From a relatively recent HipChat discussion with Simon (should
> > move to Confluence Questions):
> >
> > | I'm trying to install via eups distrib install.  How do I turn down
> > | the number of jobs run simultaneously?
> >
> > | Unfortunately, I think Mario decided not to let you easily override
> > | that one.  It's the NJOBS variable in eupspkg.sh that you need to
> > | change.  I think you may be able to set EUPSPKG_SCRIPTS to point to a
> > | .sh file that just sets that variable.
> >
> > --
> > Kian-Tat Lim, LSST Data Management, ktl at slac.stanford.edu
> > _______________________________________________
> > lsst-dm-stack-users mailing list
> > lsst-dm-stack-users at lsstcorp.org
> > http://listserv.lsstcorp.org/mailman/listinfo/lsst-dm-stack-users
> >
> >
> >
> >
> > --
> > K. Simon Krughoff
> > University of Washington
> > Department of Astronomy
> >
> > Physics-Astronomy Bldg.
> > 3910 15th Ave NE
> > Room C319
> > Seattle WA 98195-0002
> > USA
> >
> > (206)543-9487
> >
> >
>



-- 
K. Simon Krughoff
University of Washington
Department of Astronomy

Physics-Astronomy Bldg.
3910 15th Ave NE
Room C319
Seattle WA 98195-0002
USA

(206)543-9487
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://listserv.lsstcorp.org/pipermail/dm-users/attachments/20140625/46fee75e/attachment.html>