This fits with anecdotal observations of my own. In particular, the charm DIS stuff from out standard validation has never finished (up to 24 hour runs), and the DIS stuff always finished last.

We did switch away from LHAPDF to use a custom PDF - perhaps this is the issue? Some subtlety in the implementation?

pax
Gabe


On Aug 3, 2016, at 12:34 PM, Robert W Hatcher <[log in to unmask]> wrote:

Hi all,
  Per the ongoing discussion of slowness in GENIE spline generation I ran some test samples with trunk (as of 2016-07-18) and R-2_10_6 -- both using the same underlying support code, e.g. ROOT, GSL....

I used my DAG generating script which runs in stages:

1) generate { nu nu-bar } x {  e mu tau } x { free-n free-p } = 12 jobs
2) combine those
3) generated all 6 nu flavors on a single (A,Z) isotope = 106 jobs

For these tests I generated only sub-sets of the EventGeneratorList:  RES DIS QE CCMEC
and for 100 knots up to 400 GeV.

Here's a link to my evernote with numbers:


major standouts (# = sum of wall clock time in seconds):

RES stage 1   (trunk) 237134 / (r2106) 341309 = 0.7    e.g. faster 
DIS   stage 1   (trunk) 687672 / (r2106) 209392 = 3.28  e.g. slower
QE   stage 3   (trunk)   51753 / (r2106) 107353 = 0.48  e.g. faster
CCMEC stage 3   (trunk) 101307 / (r2106)   86677 = 1.17  e.g. slower

This seems to implicate DIS generation as the big problem.  I don't remember any big changes to that code per se.  Does trunk switch away from using LHAPDF for the parton distributions?  Perhaps that's a performance issue?

-robert


Robert Hatcher
Computational Physics Developer

Scientific Computing Division
Fermi National Accelerator Laboratory
PO Box 500, MS 234, Batavia, IL 60510, USA
Office: 630-840-3102
Cell:    630-234-0091




Gabriel Perdue
Associate Scientist

Scientific Computing Division
Fermi National Accelerator Laboratory
PO Box 500, MS 234, Batavia, IL 60510, USA
Office: 630-840-6499
Cell: 630-605-8062

Connect with us!