Hi Andrew
When I setup these WN's, hyper-threading was not enabled and after some time I enabled it. WN's were rebooted so obviously condor was restarted. I am draining one of the WN and I will restart all condor daemons to see whether it helps. I will let you know.
Thanks
Kashif
>>>>-----Original Message-----
>>>>From: Testbed Support for GridPP member institutes [mailto:TB-
>>>>[log in to unmask]] On Behalf Of Andrew Lahiff
>>>>Sent: 26 July 2016 17:18
>>>>To: [log in to unmask]
>>>>Subject: Re: TotalCpus in HTcondor
>>>>
>>>>
>>>>One possibility could be that in the past you had a line in the config fixing
>>>>the number of CPUs, then that was removed but you haven't restarted
>>>>condor since.
>>>>
>>>>Regards,
>>>>Andrew.
>>>>
>>>>________________________________________
>>>>From: Testbed Support for GridPP member institutes [TB-
>>>>[log in to unmask]] on behalf of Kashif Mohammad
>>>>[[log in to unmask]]
>>>>Sent: Tuesday, July 26, 2016 5:07 PM
>>>>To: [log in to unmask]
>>>>Subject: Re: TotalCpus in HTcondor
>>>>
>>>>I have grepped all config files but can't see any mention of TotalCpus . I
>>>>can see TotalCpus through condor_status but I cannot find it if I try to
>>>>dump all config_values on WN
>>>>
>>>>condor_config_val -dump | grep -i totalcpu
>>>>DEFRAG_WHOLE_MACHINE_EXPR = Cpus == TotalCpus && Offline=!=True
>>>>
>>>>Cheers
>>>>
>>>>Kashif
>>>>
>>>>
>>>>
>>>>>>>>-----Original Message-----
>>>>>>>>From: Testbed Support for GridPP member institutes [mailto:TB-
>>>>>>>>[log in to unmask]] On Behalf Of Andrew Lahiff
>>>>>>>>Sent: 26 July 2016 16:51
>>>>>>>>To: [log in to unmask]
>>>>>>>>Subject: Re: TotalCpus in HTcondor
>>>>>>>>
>>>>>>>>
>>>>>>>>And there's definitely nothing in your config that's fixing the
>>>>>>>>number of CPUs?
>>>>>>>>
>>>>>>>>Regards,
>>>>>>>>Andrew.
>>>>>>>>
>>>>>>>>________________________________________
>>>>>>>>From: Testbed Support for GridPP member institutes [TB-
>>>>>>>>[log in to unmask]] on behalf of Kashif Mohammad
>>>>>>>>[[log in to unmask]]
>>>>>>>>Sent: Tuesday, July 26, 2016 4:46 PM
>>>>>>>>To: [log in to unmask]
>>>>>>>>Subject: Re: TotalCpus in HTcondor
>>>>>>>>
>>>>>>>>Hi Andrew
>>>>>>>>
>>>>>>>>I already checked this and it was same
>>>>>>>>
>>>>>>>>
>>>>>>>>[root@t2wn123 ~]# condor_config_val DETECTED_PHYSICAL_CPUS
>>>>>>>>16
>>>>>>>>[root@t2wn123 ~]# condor_config_val DETECTED_CPUS
>>>>>>>>32
>>>>>>>>[root@t2wn123 ~]# condor_config_val COUNT_HYPERTHREAD_CPUS
>>>>true
>>>>>>>>
>>>>>>>>
>>>>>>>>root@t2wn104 ~]# condor_config_val DETECTED_PHYSICAL_CPUS
>>>>>>>>16
>>>>>>>>[root@t2wn104 ~]# condor_config_val DETECTED_CPUS
>>>>>>>>32
>>>>>>>> [root@t2wn104 ~]# condor_config_val COUNT_HYPERTHREAD_CPUS
>>>>true
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>Thanks
>>>>>>>>
>>>>>>>>Kashif
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>>>>-----Original Message-----
>>>>>>>>>>>>From: Testbed Support for GridPP member institutes [mailto:TB-
>>>>>>>>>>>>[log in to unmask]] On Behalf Of Andrew Lahiff
>>>>>>>>>>>>Sent: 26 July 2016 16:41
>>>>>>>>>>>>To: [log in to unmask]
>>>>>>>>>>>>Subject: Re: TotalCpus in HTcondor
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>What do you get if you run the following on an example from
>>>>each
>>>>>>>>>>>>type of
>>>>>>>>>>>>WN:
>>>>>>>>>>>>
>>>>>>>>>>>>condor_config_val DETECTED_PHYSICAL_CPUS
>>>>condor_config_val
>>>>>>>>>>>>DETECTED_CPUS condor_config_val
>>>>COUNT_HYPERTHREAD_CPUS
>>>>>>>>>>>>
>>>>>>>>>>>>Regards,
>>>>>>>>>>>>Andrew.
>>>>>>>>>>>>
>>>>>>>>>>>>________________________________________
>>>>>>>>>>>>From: Testbed Support for GridPP member institutes [TB-
>>>>>>>>>>>>[log in to unmask]] on behalf of Kashif Mohammad
>>>>>>>>>>>>[[log in to unmask]]
>>>>>>>>>>>>Sent: Tuesday, July 26, 2016 4:36 PM
>>>>>>>>>>>>To: [log in to unmask]
>>>>>>>>>>>>Subject: TotalCpus in HTcondor
>>>>>>>>>>>>
>>>>>>>>>>>>Hi
>>>>>>>>>>>>
>>>>>>>>>>>>I have a problem with the way Htcondor is counting TotalCpus in
>>>>>>>>>>>>one batch of WNs.
>>>>>>>>>>>>
>>>>>>>>>>>>condor_status [log in to unmask] -af TotalCpus
>>>>>>>>>>>>16.0
>>>>>>>>>>>>
>>>>>>>>>>>>condor_status [log in to unmask] -af TotalCpus
>>>>>>>>>>>>32.0
>>>>>>>>>>>>
>>>>>>>>>>>>Both WN's have hyper-threading ON and have same number of
>>>>>>>>physical
>>>>>>>>>>>>cpu
>>>>>>>>>>>>
>>>>>>>>>>>>[root@t2wn123 ~]# lscpu
>>>>>>>>>>>>Architecture: x86_64
>>>>>>>>>>>>CPU op-mode(s): 32-bit, 64-bit
>>>>>>>>>>>>Byte Order: Little Endian
>>>>>>>>>>>>CPU(s): 32
>>>>>>>>>>>>On-line CPU(s) list: 0-31
>>>>>>>>>>>>Thread(s) per core: 2
>>>>>>>>>>>>Core(s) per socket: 8
>>>>>>>>>>>>Socket(s): 2
>>>>>>>>>>>>NUMA node(s): 2
>>>>>>>>>>>>Vendor ID: GenuineIntel
>>>>>>>>>>>>CPU family: 6
>>>>>>>>>>>>Model: 63
>>>>>>>>>>>>Model name: Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz
>>>>>>>>>>>>Stepping: 2
>>>>>>>>>>>>CPU MHz: 1200.000
>>>>>>>>>>>>BogoMIPS: 5199.28
>>>>>>>>>>>>Virtualization: VT-x
>>>>>>>>>>>>L1d cache: 32K
>>>>>>>>>>>>L1i cache: 32K
>>>>>>>>>>>>L2 cache: 256K
>>>>>>>>>>>>L3 cache: 20480K
>>>>>>>>>>>>NUMA node0 CPU(s): 0-7,16-23
>>>>>>>>>>>>NUMA node1 CPU(s): 8-15,24-31
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>[root@t2wn104 ~]# lscpu
>>>>>>>>>>>>Architecture: x86_64
>>>>>>>>>>>>CPU op-mode(s): 32-bit, 64-bit
>>>>>>>>>>>>Byte Order: Little Endian
>>>>>>>>>>>>CPU(s): 32
>>>>>>>>>>>>On-line CPU(s) list: 0-31
>>>>>>>>>>>>Thread(s) per core: 2
>>>>>>>>>>>>Core(s) per socket: 8
>>>>>>>>>>>>Socket(s): 2
>>>>>>>>>>>>NUMA node(s): 2
>>>>>>>>>>>>Vendor ID: GenuineIntel
>>>>>>>>>>>>CPU family: 6
>>>>>>>>>>>>Model: 62
>>>>>>>>>>>>Model name: Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz
>>>>>>>>>>>>Stepping: 4
>>>>>>>>>>>>CPU MHz: 1200.000
>>>>>>>>>>>>BogoMIPS: 5199.24
>>>>>>>>>>>>Virtualization: VT-x
>>>>>>>>>>>>L1d cache: 32K
>>>>>>>>>>>>L1i cache: 32K
>>>>>>>>>>>>L2 cache: 256K
>>>>>>>>>>>>L3 cache: 20480K
>>>>>>>>>>>>NUMA node0 CPU(s): 0-7,16-23
>>>>>>>>>>>>NUMA node1 CPU(s): 8-15,24-31
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>I am running out of idea, any thoughts?
>>>>>>>>>>>>
>>>>>>>>>>>>Thanks
>>>>>>>>>>>>
>>>>>>>>>>>>Kashif
>>>>>>>>>>>>
|