Hi Hrachya,
It looks like it started to push records at 13:29:37 (Publishing data
into ActiveMQ Broker), but didn't blow up until 14:12:38 (Exception
thrown but not handled). If I had to guess ... reduce MaxInsertBatch in
steps (as you did with Limit) and see if that does any good. The data
you are publishing goes back to Oct 2, so there must be plenty of it. I
think "MaxInsertBatch" makes it do the work in small chunks.
Steve
Hrachya Astsatryan wrote:
> Dear all,
>
> We have the following error when run apel-publisher from
> apel.yerphi-cluster.grid.am.
> I changed the <Limit> parameter into 20000, 10000, 30000 and 40000,
> but no success.
>
>
> Cheers,
> Hrach
>
> [root@apel cron.d]# /opt/glite/bin/apel-publisher -f
> /opt/glite/etc/glite-apel-publisher/publisher-config-yaim.xml
>
> =====Starting APEL Publisher=====
> Tue Oct 25 13:26:42 UTC 2011
> Current versions of APEL RPMS:
> glite-apel-core-2.0.13-8.noarch
> glite-apel-publisher-2.0.13-6.noarch
> glite-apel-yaim-1.0.2-1.noarch
> Copying certificates from /etc/grid-security to the Java key store
> used by the APEL Publisher
> Tue Oct 25 13:28:22 UTC 2011: apel-publisher - Read-in configuration:
> [logenabled, p, inspectTables, j] [DBUsername=accounting,
> DBURL=jdbc:mysql://localhost:3306/accounting, DBPassword=****,
> site=AM-04-YERPHI, Timeout for awaiting a reply from the
> consumer.=1800000, The max. num of accounting records in each JMS
> message=2000, Batch size=500000, republish=missing]
> Tue Oct 25 13:28:22 UTC 2011: apel-publisher - ------ Starting the
> apel application ------
> Tue Oct 25 13:28:23 UTC 2011: apel-publisher - **** APEL is examining
> the schema ****
> Tue Oct 25 13:28:23 UTC 2011: apel-publisher - Checking the LcgRecords
> table
> Tue Oct 25 13:28:23 UTC 2011: apel-publisher - The LcgRecords schema
> is up-to-date
> Tue Oct 25 13:28:23 UTC 2011: apel-publisher - Checking the
> BlahdRecords table
> Tue Oct 25 13:28:33 UTC 2011: apel-publisher - The BlahdRecords schema
> is up-to-date
> Tue Oct 25 13:28:33 UTC 2011: apel-publisher - Checking the
> LcgProcessedFiles table
> Tue Oct 25 13:28:33 UTC 2011: apel-publisher - The LcgProcessedFiles
> schema is up-to-date
> Tue Oct 25 13:28:33 UTC 2011: apel-publisher - Checking the
> SpecRecords table for patch 28593
> Tue Oct 25 13:28:33 UTC 2011: apel-publisher - Checking the
> SpecRecords table for patch 65723
> Tue Oct 25 13:28:33 UTC 2011: apel-publisher - The SpecRecords schema
> is up-to-date
> Tue Oct 25 13:28:33 UTC 2011: apel-publisher - **** Schema checks
> complete ****
> Tue Oct 25 13:28:33 UTC 2011: apel-publisher - **** Combining tables
> and republishing in LcgRecords ****
> Tue Oct 25 13:28:33 UTC 2011: apel-publisher - Checking valid CPU spec
> data exists
> Tue Oct 25 13:28:33 UTC 2011: apel-publisher - CPU spec values found
> Tue Oct 25 13:28:39 UTC 2011: apel-publisher -
> ====================================
> Tue Oct 25 13:28:39 UTC 2011: apel-publisher - Synchronisation
> data check
> Tue Oct 25 13:28:39 UTC 2011: apel-publisher -
> ====================================
> Tue Oct 25 13:28:39 UTC 2011: apel-publisher - Finding all records in
> local database since the last successful publish timestamp :
> 2011-10-02 10:20:45
> Tue Oct 25 13:28:44 UTC 2011: apel-publisher - Record/s found: 177531
> Tue Oct 25 13:28:44 UTC 2011: apel-publisher - Checking Archiver is
> Online
> Tue Oct 25 13:28:56 UTC 2011: apel-publisher - Archiver Alive
> Tue Oct 25 13:28:56 UTC 2011: apel-publisher - Archiver Record Count:
> Record/s found site AM-04-YERPHI : 122011
> Tue Oct 25 13:28:56 UTC 2011: apel-publisher - WARNING - Detected
> missing records, republishing data starting from: 2011-10-02 10:20:45
> Tue Oct 25 13:29:37 UTC 2011: apel-publisher - Publishing data into
> ActiveMQ Broker
> Tue Oct 25 14:12:38 UTC 2011: apel-publisher - Exception thrown but
> not handled. Please submit a GGUS ticket
> Tue Oct 25 14:12:38 UTC 2011: apel-publisher - program aborted
> org.glite.apel.core.ApelException: javax.jms.IllegalStateException:
> The Session is closed
> at
> org.glite.apel.publisher.AccountPublisher.handleException(Unknown Source)
> at org.glite.apel.publisher.AccountPublisher.executeBatch(Unknown
> Source)
> at org.glite.apel.publisher.AccountPublisher.publish(Unknown Source)
> at
> org.glite.apel.publisher.AccountManager.chkArchivedTuples(Unknown Source)
> at org.glite.apel.publisher.AccountManager.run(Unknown Source)
> at org.glite.apel.publisher.ApelPublisher.runJoinProcessor(Unknown
> Source)
> at org.glite.apel.publisher.ApelPublisher.run(Unknown Source)
> at org.glite.apel.publisher.ApelPublisher.main(Unknown Source)
> Caused by: javax.jms.IllegalStateException: The Session is closed
> at
> org.apache.activemq.ActiveMQSession.checkClosed(ActiveMQSession.java:655)
> at
> org.apache.activemq.ActiveMQSession.configureMessage(ActiveMQSession.java:643)
>
> at
> org.apache.activemq.ActiveMQSession.createObjectMessage(ActiveMQSession.java:328)
>
> at
> org.apache.activemq.ActiveMQTopicSession.createObjectMessage(ActiveMQTopicSession.java:192)
>
> ... 7 more
> =====Starting APEL Publisher=====
>
>
>
>
--
Steve Jones [log in to unmask]
System Administrator office: 220
High Energy Physics Division tel (int): 42334
Oliver Lodge Laboratory tel (ext): +44 (0)151 794 2334
University of Liverpool http://www.liv.ac.uk/physics/hep/
|