Hello
indeed, we are publishing now.
Many thanks to Stephen, Govind, Alessandra and Daniela
Elena
> On 11 Dec 2012, at 14:07, Daniela Bauer wrote:
>
>> Hi Elena,
>>
>> it can take several days before that portal synchronizes. If you only published today after previous failures, I would give it at least 3 days, possibly more.
>>
>> Cheers,
>> Daniela
>>
>>
>> On 11 December 2012 14:01, Elena Korolkova <[log in to unmask]> wrote:
>> Hi Steve
>> On 11 Dec 2012, at 11:54, Stephen Jones wrote:
>>
>>> Dunno what the problem is - it could just take some time to propagate?
>>
>> I was checking https://accounting.egi.eu/user/site_view.php?seloption=UKI-NORTHGRID-SHEF-HEP&query=normcpu&startYear=2012&startMonth=11&endYear=2012&endMonth=12
>>
>> It has one record for Nov12 after we run republishing.
>> How long does it takes to propagate publishing?
>>
>>
>>>
>>> But there is such a thing in the world as the "Gap Publisher".
>>>
>>> To use it, you have to uncomment some of the XML in /etc/glite-apel-pbs/parser-config-yaim.xml
>>
>> We haven't published until yesterday because we had a problem with accounting user.
>> So we shouldn't have gaps.
>>
>> What else can be wrong?
>>
>> Thank you very much for your help.
>>
>> Elena
>>
>>
>>>
>>> Steve
>>>
>>>
>>> On 12/11/2012 11:47 AM, Elena Korolkova wrote:
>>>> Hello
>>>>
>>>> we have a problem with db access for accounting user. It was fixed yesterday.
>>>>
>>>> Publishing is running ok on ce and apel:
>>>>
>>>> env APEL_HOME=/ /usr/bin/apel-pbs-log-parser -f /etc/glite-apel-pbs/parser-config-yaim.xml
>>>> .......
>>>> Tue Dec 11 10:23:52 UTC 2012: apel-pbs-log-parser - Ignoring already processed accounting log file: lcgce2.shef.ac.uk /var/log/cream/accounting/blahp.log-20121202
>>>> Tue Dec 11 10:23:52 UTC 2012: apel-pbs-log-parser - Ignoring already processed accounting log file: lcgce2.shef.ac.uk /var/log/cream/accounting/blahp.log-20121208
>>>> Tue Dec 11 10:23:52 UTC 2012: apel-pbs-log-parser - Ignoring already processed accounting log file: lcgce2.shef.ac.uk /var/log/cream/accounting/blahp.log-20121124
>>>> Tue Dec 11 10:23:52 UTC 2012: apel-pbs-log-parser - Ignoring already processed accounting log file: lcgce2.shef.ac.uk /var/log/cream/accounting/blahp.log-20121107
>>>> Tue Dec 11 10:23:52 UTC 2012: apel-pbs-log-parser - Blahd records inserted: 2679
>>>> Tue Dec 11 10:23:52 UTC 2012: apel-pbs-log-parser - ------ Processing finished -----
>>>>
>>>> [root@lcg ~]# env APEL_HOME=/ JAVA_HOME=/etc/alternatives/java_sdk_1.6.0 /usr/bin/apel-publisher -f /etc/glite-apel-publisher/publisher-config-yaim.xml
>>>> =====Starting APEL Publisher=====
>>>> Tue Dec 11 10:48:05 GMT 2012
>>>> Current versions of APEL RPMS:
>>>> glite-apel-core-2.0.14-4.sl5.noarch
>>>> glite-apel-yaim-1.0.2-3.sl5.noarch
>>>> glite-apel-publisher-2.0.16-0.sl5.noarch
>>>> emi-apel-1.0.0-0.sl5.noarch
>>>> Copying certificates from /etc/grid-security to the Java key store used by the APEL Publisher
>>>> Tue Dec 11 10:49:43 UTC 2012: apel-publisher - Read-in configuration: [logenabled, p, inspectTables, j, publishGlobalDN] [DBUsername=accounting, DBURL=jdbc:mysql://localhost:3306/accounting, DBPassword=****, site=UKI-NORTHGRID-SHEF-HEP, Timeout for awaiting a reply from the consumer.=1800000, The max. num of accounting records in each JMS message=1000, Batch size=100000, republish=missing]
>>>> Tue Dec 11 10:49:43 UTC 2012: apel-publisher - ------ Starting the APEL Publisher ------
>>>> Tue Dec 11 10:49:44 UTC 2012: apel-publisher - **** APEL is examining the schema ****
>>>> Tue Dec 11 10:49:44 UTC 2012: apel-publisher - Checking the LcgRecords table
>>>> Tue Dec 11 10:49:44 UTC 2012: apel-publisher - The LcgRecords schema is up-to-date
>>>> Tue Dec 11 10:49:44 UTC 2012: apel-publisher - Checking the BlahdRecords table
>>>> ........
>>>> Tue Dec 11 10:49:44 UTC 2012: apel-publisher - Synchronisation data check
>>>> Tue Dec 11 10:49:44 UTC 2012: apel-publisher - ====================================
>>>> Tue Dec 11 10:49:44 UTC 2012: apel-publisher - Finding all records in local database since the last successful publish timestamp : 2012-12-11 09:34:00
>>>> .......
>>>>
>>>> Tue Dec 11 11:31:10 UTC 2012: apel-publisher - Publishing 1420 records...
>>>> Tue Dec 11 11:31:10 UTC 2012: apel-publisher - Published 1420 records to the APEL server.
>>>> Tue Dec 11 11:31:10 UTC 2012: apel-publisher - If filtering by VO, the number of records joined might differ from the number of records published
>>>> Tue Dec 11 11:31:10 UTC 2012: apel-publisher - ====================================
>>>> Tue Dec 11 11:31:10 UTC 2012: apel-publisher - Publishing Summary Data
>>>> Tue Dec 11 11:31:10 UTC 2012: apel-publisher - ====================================
>>>> Tue Dec 11 11:31:10 UTC 2012: apel-publisher - Data will be written to Sync Table: LcgRecordsSync_v2
>>>> Tue Dec 11 11:36:41 UTC 2012: apel-publisher - Publishing summary data into ActiveMQ Broker
>>>> Tue Dec 11 11:36:41 UTC 2012: apel-publisher - ------ APEL Publisher finished ------
>>>>
>>>>
>>>> But https://gridppnagios.physics.ox.ac.uk/nagios/cgi-bin/extinfo.cgi?type=2&host=lcgce2.shef.ac.uk&service=org.apel.APEL-Pub shows that last published 28 days ago: 2012-11-12
>>>>
>>>> I would appreciate your help very much.
>>>>
>>>> Elena
>>>> __________________________________________________
>>>> Dr Elena Korolkova
>>>> Email: [log in to unmask]
>>>> Tel.: +44 (0)114 2223553
>>>> Fax: +44 (0)114 2223555
>>>> Department of Physics and Astronomy
>>>> University of Sheffield
>>>> Sheffield, S3 7RH, United Kingdom
>>>
>>>
>>> --
>>> Steve Jones [log in to unmask]
>>> System Administrator office: 220
>>> High Energy Physics Division tel (int): 42334
>>> Oliver Lodge Laboratory tel (ext): +44 (0)151 794 2334
>>> University of Liverpool http://www.liv.ac.uk/physics/hep/
>>
>> __________________________________________________
>> Dr Elena Korolkova
>> Email: [log in to unmask]
>> Tel.: +44 (0)114 2223553
>> Fax: +44 (0)114 2223555
>> Department of Physics and Astronomy
>> University of Sheffield
>> Sheffield, S3 7RH, United Kingdom
>>
>>
>>
>> --
>> Sent from the pit of despair
>>
>> -----------------------------------------------------------
>> [log in to unmask]
>> HEP Group/Physics Dep
>> Imperial College
>> Tel: +44-(0)20-75947810
>> http://www.hep.ph.ic.ac.uk/~dbauer/
>
> __________________________________________________
> Dr Elena Korolkova
> Email: [log in to unmask]
> Tel.: +44 (0)114 2223553
> Fax: +44 (0)114 2223555
> Department of Physics and Astronomy
> University of Sheffield
> Sheffield, S3 7RH, United Kingdom
>
>
>
>
__________________________________________________
Dr Elena Korolkova
Email: [log in to unmask]
Tel.: +44 (0)114 2223553
Fax: +44 (0)114 2223555
Department of Physics and Astronomy
University of Sheffield
Sheffield, S3 7RH, United Kingdom
|