Hi,
I'm testing a CE using a LSF 7. The jobs are submitted correctly, no
failures, but the CE somewhat does not realize in all the cases that the
jobs are finished.
This is a snapshot of a job sequence:
Oct 7 14:42:08 atlas-ce-02 gridinfo: [5704-24160] Submitted job
1254919261:lcglsf:internal_2426506480:23356.1254919255 to batch system
lcglsf with ID 326
Oct 7 14:42:09 atlas-ce-02 gridinfo: [5704-24160] Submitted job
1254919250:lcglsf:internal_3935407022:23153.1254919247 to batch system
lcglsf with ID 328
Oct 7 14:42:09 atlas-ce-02 gridinfo: [5704-24160] Submitted job
1254919250:lcglsf:internal_2132828710:23143.1254919246 to batch system
lcglsf with ID 327
Oct 7 15:02:07 atlas-ce-02 gridinfo: [5704-5225] Submitted job
1254920348:lcglsf:internal_3511602746:3123.1254920345 to batch system
lcglsf with ID 329
Oct 7 15:02:09 atlas-ce-02 gridinfo: [5704-5225] Submitted job
1254920348:lcglsf:internal_347852131:3036.1254920342 to batch system
lcglsf with ID 333
Oct 7 15:02:09 atlas-ce-02 gridinfo: [5704-5225] Submitted job
1254920348:lcglsf:internal_1751871149:3113.1254920345 to batch system
lcglsf with ID 335
Oct 7 15:02:09 atlas-ce-02 gridinfo: [5704-5225] Submitted job
1254920349:lcglsf:internal_1934185573:3103.1254920344 to batch system
lcglsf with ID 332
Oct 7 15:02:09 atlas-ce-02 gridinfo: [5704-5225] Submitted job
1254920348:lcglsf:internal_1999232832:3134.1254920346 to batch system
lcglsf with ID 331
Oct 7 15:02:09 atlas-ce-02 gridinfo: [5704-5225] Submitted job
1254920348:lcglsf:internal_1048838566:3048.1254920343 to batch system
lcglsf with ID 334
Oct 7 15:02:09 atlas-ce-02 gridinfo: [5704-5225] Submitted job
1254920348:lcglsf:internal_3720832631:3091.1254920344 to batch system
lcglsf with ID 330
Oct 7 15:02:09 atlas-ce-02 gridinfo: [5704-5225] Submitted job
1254920349:lcglsf:internal_3321202548:3081.1254920343 to batch system
lcglsf with ID 336
Oct 7 15:17:07 atlas-ce-02 gridinfo: [5704-14810] Submitted job
1254921204:lcglsf:internal_2047859351:12351.1254921201 to batch system
lcglsf with ID 337
Oct 7 15:17:09 atlas-ce-02 gridinfo: [5704-14810] Submitted job
1254921209:lcglsf:internal_3601308004:12538.1254921205 to batch system
lcglsf with ID 338
Oct 7 15:17:09 atlas-ce-02 gridinfo: [5704-14810] Submitted job
1254921205:lcglsf:internal_2988471193:12301.1254921200 to batch system
lcglsf with ID 342
Oct 7 15:17:09 atlas-ce-02 gridinfo: [5704-14810] Submitted job
1254921204:lcglsf:internal_109334895:12341.1254921201 to batch system
lcglsf with ID 339
Oct 7 15:17:09 atlas-ce-02 gridinfo: [5704-14810] Submitted job
1254921204:lcglsf:internal_109334895:12291.1254921199 to batch system
lcglsf with ID 341
Oct 7 15:17:09 atlas-ce-02 gridinfo: [5704-14810] Submitted job
1254921204:lcglsf:internal_3041195945:12281.1254921199 to batch system
lcglsf with ID 340
Oct 7 15:17:09 atlas-ce-02 gridinfo: [5704-14810] Submitted job
1254921209:lcglsf:internal_1641904425:12403.1254921204 to batch system
lcglsf with ID 343
Oct 7 15:17:09 atlas-ce-02 gridinfo: [5704-14810] Submitted job
1254921204:lcglsf:internal_2198855129:12331.1254921200 to batch system
lcglsf with ID 344
Oct 7 15:36:07 atlas-ce-02 gridinfo: [5460-26561] Submitted job
1254922535:lcglsf:internal_2045004167:26034.1254922535 to batch system
lcglsf with ID 345
Oct 7 15:37:18 atlas-ce-02 gridinfo: [5460-27250] Job
1254922535:lcglsf:internal_2045004167:26034.1254922535 (ID 345) has
finished
Oct 7 15:57:07 atlas-ce-02 gridinfo: [5704-7076] Submitted job
1254923716:lcglsf:internal_235056927:5676.1254923711 to batch system
lcglsf with ID 346
Oct 7 16:12:07 atlas-ce-02 gridinfo: [5704-17176] Submitted job
1254924694:lcglsf:internal_1315879841:16725.1254924693 to batch system
lcglsf with ID 347
Oct 7 16:12:08 atlas-ce-02 gridinfo: [5704-17176] Submitted job
1254924694:lcglsf:internal_3007735722:16712.1254924692 to batch system
lcglsf with ID 350
Oct 7 16:12:08 atlas-ce-02 gridinfo: [5704-17176] Submitted job
1254924694:lcglsf:internal_3808433804:16735.1254924693 to batch system
lcglsf with ID 349
Oct 7 16:12:08 atlas-ce-02 gridinfo: [5704-17176] Submitted job
1254924694:lcglsf:internal_1175346508:16702.1254924692 to batch system
lcglsf with ID 348
Oct 7 16:17:07 atlas-ce-02 gridinfo: [5704-20699] Submitted job
1254924699:lcglsf:internal_1421078797:16745.1254924694 to batch system
lcglsf with ID 352
Oct 7 16:17:07 atlas-ce-02 gridinfo: [5704-20699] Submitted job
1254924767:lcglsf:internal_2459766253:17994.1254924763 to batch system
lcglsf with ID 353
Oct 7 16:17:07 atlas-ce-02 gridinfo: [5704-20699] Submitted job
1254924699:lcglsf:internal_4029440046:16789.1254924694 to batch system
lcglsf with ID 351
Oct 7 16:22:06 atlas-ce-02 gridinfo: [5704-23824] Job
1254923716:lcglsf:internal_235056927:5676.1254923711 (ID 346) has
finished
Oct 7 16:32:07 atlas-ce-02 gridinfo: [5704-30075] Submitted job
1254925850:lcglsf:internal_1642437732:29120.1254925844 to batch system
lcglsf with ID 354
Oct 7 16:32:07 atlas-ce-02 gridinfo: [5704-30075] Submitted job
1254925815:lcglsf:internal_2751500698:28801.1254925809 to batch system
lcglsf with ID 355
Oct 7 16:42:08 atlas-ce-02 gridinfo: [5704-8885] Submitted job
1254926347:lcglsf:internal_2107384310:2290.1254926343 to batch system
lcglsf with ID 356
Oct 7 16:57:06 atlas-ce-02 gridinfo: [5704-18279] Job
1254925850:lcglsf:internal_1642437732:29120.1254925844 (ID 354) has
finished
Oct 7 16:57:07 atlas-ce-02 gridinfo: [5704-18327] Submitted job
1254927337:lcglsf:internal_330750791:17222.1254927332 to batch system
lcglsf with ID 357
Oct 7 16:57:08 atlas-ce-02 gridinfo: [5704-18459] Submitted job
1254927337:lcglsf:internal_2534685186:17232.1254927332 to batch system
lcglsf with ID 358
Oct 7 17:32:07 atlas-ce-02 gridinfo: [5704-9197] Submitted job
1254929342:lcglsf:internal_1674173513:7179.1254929338 to batch system
lcglsf with ID 359
Oct 7 17:42:06 atlas-ce-02 gridinfo: [5704-15271] Submitted job
1254929939:lcglsf:internal_3863902492:13492.1254929933 to batch system
lcglsf with ID 360
Oct 7 18:32:07 atlas-ce-02 gridinfo: [5704-14491] Submitted job
1254932958:lcglsf:internal_490199667:12650.1254932953 to batch system
lcglsf with ID 361
At the time of the last line (Oct 7 18:32:07) all the previous jobs
were already finished, but the CE only saw a few as such.
Any help is highly appreciated, regards,
Alessandro
|