Mmm - okay. Does the user "han" exist on the torque server?
Sean
On 29 May 2014 22:06, Anatoliy Khmelevskiy <[log in to unmask]> wrote:
> The fact that munge is running on the submission node and on the server. If
> it were not so then the pbsnodes would not be carried out.
>
>
> 2014-05-29 14:36 GMT+03:00 Sean Crosby <[log in to unmask]>:
>
>> Hi Anatol,
>>
>> Invalid credentials are normally caused by munge not running on your
>> submission node (or whatever the auth system is you use, e.g. munge or
>> trqauthd).
>>
>> Sean
>>
>> On 29 May 2014 20:07, Anatoliy Khmelevskiy <[log in to unmask]> wrote:
>> > Dear all,
>> >
>> > I would like to be able to run jobs from UI to torque-server through
>> > qsub.
>> >
>> > UI - npg8.basnet.by
>> > CREAM+TORQUE - npg1.basnet.by
>> >
>> > On the UI, CREAM and WN the user created.
>> >
>> > If I run the commands on UI as root all is well
>> >
>> >
>> > [root@npg8 etc]# pbsnodes
>> > node1.basnet.by
>> > state = free
>> > np = 8
>> > properties = lcgpro
>> > ntype = cluster
>> > status =
>> >
>> > rectime=1401356834,varattr=,jobs=,state=free,netload=550397836,gres=,loadave=0.01,ncpus=8,physmem=3917212kb,availmem=3641632kb,totmem=3917212kb,idletime=248616,nusers=1,nsessions=1,sessions=13314,uname=Linux
>> > node1.basnet.by 2.6.32-431.17.1.el6.x86_64 #1 SMP Wed May 7 14:14:17 CDT
>> > 2014 x86_64,opsys=linux
>> > gpus = 0
>> >
>> > node2.basnet.by
>> > state = free
>> > np = 8
>> > properties = lcgpro
>> > ntype = cluster
>> > status =
>> >
>> > rectime=1401356834,varattr=,jobs=,state=free,netload=551822166,gres=,loadave=0.00,ncpus=8,physmem=3917212kb,availmem=3647644kb,totmem=3917212kb,idletime=251507,nusers=1,nsessions=1,sessions=10277,uname=Linux
>> > node2.basnet.by 2.6.32-431.17.1.el6.x86_64 #1 SMP Wed May 7 14:14:17 CDT
>> > 2014 x86_64,opsys=linux
>> > gpus = 0
>> >
>> > node3.basnet.by
>> > state = free
>> > np = 8
>> > properties = lcgpro
>> > ntype = cluster
>> > status =
>> >
>> > rectime=1401356829,varattr=,jobs=,state=free,netload=551889615,gres=,loadave=0.00,ncpus=8,physmem=3917212kb,availmem=3647936kb,totmem=3917212kb,idletime=244994,nusers=1,nsessions=1,sessions=26946,uname=Linux
>> > node3.basnet.by 2.6.32-431.17.1.el6.x86_64 #1 SMP Wed May 7 14:14:17 CDT
>> > 2014 x86_64,opsys=linux
>> > gpus = 0
>> >
>> >
>> > [root@npg8 etc]# qstat -n
>> >
>> > npg1.basnet.by:
>> >
>> > Req'd Req'd Elap
>> > Job ID Username Queue Jobname SessID NDS TSK
>> > Memory Time S Time
>> > -------------------- -------- -------- ---------------- ------ ----- ---
>> > ------ ----- - -----
>> > 46.npg1.basnet.b nuclearb nuclearb cream_577823495 -- 3 24
>> > -- -- R --
>> >
>> > node3+node3+node3+node3+node3+node3+node3+node3+node2+node2+node2+node2
>> >
>> > +node2+node2+node2+node2+node1+node1+node1+node1+node1+node1+node1+node1
>> >
>> >
>> >
>> > But if I run the commands on UI as user, I get error
>> >
>> > [han@npg8 pbs]$ qstat
>> > qstat: Invalid credential
>> >
>> > [han@npg8 pbs]$ qsub sleep.qs
>> > qsub: Invalid credential
>> >
>> >
>> > On TORQUE I get
>> >
>> > 05/29/2014 13:02:40;0080;PBS_Server;Req;req_reject;Reject reply
>> > code=15021(Invalid credential), aux=0, type=QueueJob, from
>> > [log in to unmask]
>> >
>> > [root@npg1 etc]# qmgr
>> > Max open servers: 9
>> > Qmgr: print server
>> > #
>> > # Create queues and set their attributes.
>> > #
>> > #
>> > # Create and define queue nuclearby
>> > #
>> > create queue nuclearby
>> > set queue nuclearby queue_type = Execution
>> > set queue nuclearby acl_hosts = npg8.basnet.by
>> > set queue nuclearby acl_users = han
>> > set queue nuclearby resources_max.cput = 48:00:00
>> > set queue nuclearby resources_max.walltime = 72:00:00
>> > set queue nuclearby acl_group_enable = True
>> > set queue nuclearby acl_groups = nuclearby
>> > set queue nuclearby acl_groups += nuclearbysgm
>> > set queue nuclearby acl_groups += han
>> > set queue nuclearby enabled = True
>> > set queue nuclearby started = True
>> > ...
>> > set server scheduling = True
>> > set server acl_host_enable = False
>> > set server acl_hosts = npg1.basnet.by
>> > set server acl_hosts += npg8.basnet.by
>> > set server managers = [log in to unmask]
>> > set server operators = [log in to unmask]
>> > set server default_queue = dteam
>> > set server log_events = 511
>> > set server mail_from = adm
>> > set server query_other_jobs = True
>> > set server scheduler_iteration = 600
>> > set server node_check_rate = 150
>> > set server tcp_timeout = 6
>> > set server default_node = lcgpro
>> > set server node_pack = False
>> > set server mail_domain = never
>> > set server kill_delay = 10
>> > set server submit_hosts = npg8.basnet.by
>> > set server next_job_number = 47
>> > set server authorized_users = *@npg8.basnet.by
>> > set server authorized_users += *@npg1.basnet.by
>> >
>> >
>> > Any ideas?
>> >
>> > Thank you in advance.
>> > Anatol.
>> >
>> > --
>> > Khmialeuski Anatol,
>> > NGI_BY Operations Deputy Manager,
>> > BY-JIPNR-Sosny Site Administrator,
>> > State Scientific Institution
>> > "Joint Institute for Power and Nuclear Research - Sosny"
>> > 99 Academician A.K.Krasin Str., Minsk BY-220109, Belarus
>>
>>
>>
>> --
>> Sean Crosby
>> Research Computing System Administrator and Developer
>> ARC Centre of Excellence for Particle Physics at the Terascale
>> School of Physics | University of Melbourne Vic 3010
>> T: +61 3 8344 8093
>
>
>
>
> --
> Khmialeuski Anatol,
> NGI_BY Operations Deputy Manager,
> BY-JIPNR-Sosny Site Administrator,
> State Scientific Institution
> "Joint Institute for Power and Nuclear Research - Sosny"
> 99 Academician A.K.Krasin Str., Minsk BY-220109, Belarus
--
Sean Crosby
Research Computing System Administrator and Developer
ARC Centre of Excellence for Particle Physics at the Terascale
School of Physics | University of Melbourne Vic 3010
T: +61 3 8344 8093
|