- Published on Friday, 11 April 2008 05:53
- Written by Douglas Eadline
- Hits: 3478
As the Head Monkey around here, I often get questions sent to me about clusters. I thought it might make sense to share some of the questions (and answers). Please feel free to comment and offer your insights as well. Here is today's question.
Question: I am having trouble finding current information on hyper-threading and clusters, or even hyper-threading and heavy loads that is not at least 2 years out of date. I am about to overhaul our engineering cluster and would really like to find some information on the current state of things before I enable the HT ability on the cluster. Read on for my answer.
By the way, I'm open to other questions as well. Head on over to my contact page and drop me line. I'll also try an reach out to some of the more seasoned cluster jocks for answers as well. And finally, you can always post and search the adept Beowulf Mailing List. Oh, and try and keep the questions about HPC clusters.
Answer: Hyper-threading is not really used on newer chips. It was used on the Pentium 4 line, but the newer multi-core Pentium M series (Merom, Conroe, and Woodcrest) do not have hyper-threading. There is some talk by Intel that the new Nehalem will again use hyper-threading.
In term of HPC, the consensus is that you want to turn off hyper-threading on compute nodes. The reason is that Linux will "see" two CPUs for each processor (The P4 is a single core). But it is not really two processors and you should not overload the processor with two "heavy" compute jobs because they share the same FPU.
Hyper-threading seems to work best when you have more threads than cores, and the threads are waiting on IO, that way the second virtual processor can "fill in the gaps". If the head node is serving NFS to the nodes, it may make sense to turn on hyper-threading (on the head node).
Login And Newsletter
We have 110 guests and no members online
Bright Cluster Manager Wrangles New NVIDIA Tesla K80 GPU
22 Nov 2014 | 10:13 am
Mark Your Calendars: Here are the SC Conference Cities Through 2020
22 Nov 2014 | 8:24 am
Sci-Fi Original: Angels of Silence
21 Nov 2014 | 5:42 pm
#SC14 day 2: @LuceraHQ tops @scalableinfo hardware … with Scalable Info hardware …
19 Nov 2014 | 11:57 am
Starting to come around to the idea that swap in any form, is evil
16 Nov 2014 | 12:37 pm
#sc14 T-minus 2 days and counting #HPCmatters
16 Nov 2014 | 12:12 pm