ChatGPT解决这个技术问题 Extra ChatGPT

Programmatically find the number of cores on a machine

Is there a way to determine how many cores a machine has from C/C++ in a platform-independent way? If no such thing exists, what about determining it per-platform (Windows/*nix/Mac)?

If you want to use it find out how many threads to start please use NUMBER_OF_PROCESSORS as primary measure. I leave it as an excercise to you why this is much better (if people would use it more) then using hardware cores. How much cores belong to your program are an environmental issue!
Note that std::thread::hardware_concurrency returns the number of physical CPU cores, but nproc in Linux shows only the number of CPU cores the current process can run on, which can be controlled with sched_setaffinity. I haven't found a way to get that instead from standard C++:, see e.g. in Python: stackoverflow.com/questions/1006289/…

B
BullyWiiPlaza

C++11

#include <thread>

//may return 0 when not able to detect
const auto processor_count = std::thread::hardware_concurrency();

Reference: std::thread::hardware_concurrency

In C++ prior to C++11, there's no portable way. Instead, you'll need to use one or more of the following methods (guarded by appropriate #ifdef lines):

Win32 SYSTEM_INFO sysinfo; GetSystemInfo(&sysinfo); int numCPU = sysinfo.dwNumberOfProcessors;

Linux, Solaris, AIX and Mac OS X >=10.4 (i.e. Tiger onwards) int numCPU = sysconf(_SC_NPROCESSORS_ONLN);

FreeBSD, MacOS X, NetBSD, OpenBSD, etc. int mib[4]; int numCPU; std::size_t len = sizeof(numCPU); /* set the mib for hw.ncpu */ mib[0] = CTL_HW; mib[1] = HW_AVAILCPU; // alternatively, try HW_NCPU; /* get the number of CPUs from the system */ sysctl(mib, 2, &numCPU, &len, NULL, 0); if (numCPU < 1) { mib[1] = HW_NCPU; sysctl(mib, 2, &numCPU, &len, NULL, 0); if (numCPU < 1) numCPU = 1; }

HPUX int numCPU = mpctl(MPC_GETNUMSPUS, NULL, NULL);

IRIX int numCPU = sysconf(_SC_NPROC_ONLN);

Objective-C (Mac OS X >=10.5 or iOS) NSUInteger a = [[NSProcessInfo processInfo] processorCount]; NSUInteger b = [[NSProcessInfo processInfo] activeProcessorCount];


@mcandre: that is left as an exercise for the reader. If I were implementing I'd probably use template-policy approach where the policy was defined in preprocessor directives. Or... you could use boost thread::hardware_concurrency().
as a point of clarification the Win32 solution returns total number of cores (what was asked for) not total number of physical CPUs.
The Linux/Solaris/AIX way also works on FreeBSD and has since at least 2006. Also, that will return the CPUs online, if a system is capable of turning some off they might not be counted. Calling sysconf with "_SC_NPROCESSORS_CONF" will return the total CPUs configured.
A couple of things to be aware of. HW_NCPU is deprecated on OS X. On Windows GetSystemInfo is only useful if your system has 32 logical processors or less, use GetLogicalProcessorInformation for systems that have more than 32 logical processors.
@Trejkaz the documentaion clearly says "logical" - which is always counting HT cores, the word "physical" always refers to cores reported by the BIOS / UEFI as cores may also be emulated / virtualized. You can differentiate between HT/non-HT cores with functions like GetLogicalProcessorInformation, for instance. Note : HT != emulation or virtualization, thats a big difference, HT is a hardware optimization, so to speak
F
Ferruccio

This functionality is part of the C++11 standard.

#include <thread>

unsigned int nthreads = std::thread::hardware_concurrency();

For older compilers, you can use the Boost.Thread library.

#include <boost/thread.hpp>

unsigned int nthreads = boost::thread::hardware_concurrency();

In either case, hardware_concurrency() returns the number of threads that the hardware is capable of executing concurrently based on the number of CPU cores and hyper-threading units.


Seconded...was going to use the sample code above and some preprocessor macros to expose a single function, but the hard-work was done for me.
For win32, it's a call to GetSystemInfo. (As of boost Version 1.41.0) Does that capture all the info to determine how many worker threads would be effective? Does one need to consider both the number of cores and hyper-threading? unsigned thread::hardware_concurrency() { SYSTEM_INFO info={0}; GetSystemInfo(&info); return info.dwNumberOfProcessors; }
According to MSDN, GetSystemInfo() returns the number of "physical processors" in dwNumberOfProcessors but it doesn't define what it means by that. The Boost documentation seems to claim that it includes hyperthreading units.
a
angainor

OpenMP is supported on many platforms (including Visual Studio 2005) and it offers a

int omp_get_num_procs();

function that returns the number of processors/cores available at the time of call.


because it is a wrong answer. From gcc.gnu.org/bugzilla/show_bug.cgi?id=37586 "omp_get_num_procs () will only return smaller number than the number of system CPUs online, if GOMP_CPU_AFFINITY env var is used, or if the calling process and/or thread has CPU affinity limited to a subset of CPUs". So if you earlier call e.g., sched_setaffinity this will not work.
This function returns the number of CPUs available to the calling process. Isn't it the most common use case anyway? Outsize of some useless reporting purposes, the actual number of CPU hardware cores is not relevant to you if you cannot take advantage of them in your code.
@EvanTeran Besides the fact that it was the purpose of the question, it can of course be useful. For example, for the purpose of setting thread affinity. Say, I want to run 4 threads bound to four last CPU cores on my machine, instead of four first cores. And besides, there are other ways of parallelizing the code except of OpenMP. I may want to spawn pthreads myself. Those are surely available and not restricted by OpenMP environment variables.
This returns the number of logical CPUs, not cores (physical CPUs) as such.
t
tshepang

If you have assembly-language access, you can use the CPUID instruction to get all sorts of information about the CPU. It's portable between operating systems, though you'll need to use manufacturer-specific information to determine how to find the number of cores. Here's a document that describes how to do it on Intel chips, and page 11 of this one describes the AMD specification.


It may have been downvoted because the question is tagged as C++ and this answer doesn't apply to systems running C++ on non-x86 architectures (ARM, PPC, etc.). I'm not saying it's a good reason to downvote an answer, just a possibility.
One pitfall of this method is if you're using CPUID to detect HyperThreading on Intel processors. I ran into this problem on my laptop: while the CPU that I put into the machine supports HyperThreading (and, of course, reports that it does via CPUID), the BIOS does not. Therefore, you shouldn't attempt to utilize HT capability simply from a CPUID read. Since you can't query the BIOS about HT support (no way that I've seen), the OS should be queried to get the logical processor count.
D
Dirk-Jan Kroon

(Almost) Platform Independent function in c-code

#ifdef _WIN32
#include <windows.h>
#elif MACOS
#include <sys/param.h>
#include <sys/sysctl.h>
#else
#include <unistd.h>
#endif

int getNumCores() {
#ifdef WIN32
    SYSTEM_INFO sysinfo;
    GetSystemInfo(&sysinfo);
    return sysinfo.dwNumberOfProcessors;
#elif MACOS
    int nm[2];
    size_t len = 4;
    uint32_t count;

    nm[0] = CTL_HW; nm[1] = HW_AVAILCPU;
    sysctl(nm, 2, &count, &len, NULL, 0);

    if(count < 1) {
        nm[1] = HW_NCPU;
        sysctl(nm, 2, &count, &len, NULL, 0);
        if(count < 1) { count = 1; }
    }
    return count;
#else
    return sysconf(_SC_NPROCESSORS_ONLN);
#endif
}

Seems HW_NCPU is deprecated on OS X source
@user152949 what is the proposed alternative? (link is broken)
J
JesperE

On Linux, you can read the /proc/cpuinfo file and count the cores.


Except that that also counts hyperthreaded or other SMT solutions as more cores...
@Arafangion: hyperthreading is not true parallel execution, it's a technology for reducing context switching overhead. A hyperthreaded cpu can only execute one thread at a time, but it can store the architectural state (register values etc.) of two threads at the same time. The performance characteristics are very different from having two cores.
@Wim: That's not completely correct. CPUs with hyperthreading generally have multiple ALUs and can dispatch multiple instructions per cycle. If due to data dependencies and stalls, not all the ALUs can be kept busy by one thread, those ALUs will instead be used for simultaneous execution of the second hardware thread.
t
tshepang

Note that "number of cores" might not be a particularly useful number, you might have to qualify it a bit more. How do you want to count multi-threaded CPUs such as Intel HT, IBM Power5 and Power6, and most famously, Sun's Niagara/UltraSparc T1 and T2? Or even more interesting, the MIPS 1004k with its two levels of hardware threading (supervisor AND user-level)... Not to mention what happens when you move into hypervisor-supported systems where the hardware might have tens of CPUs but your particular OS only sees a few.

The best you can hope for is to tell the number of logical processing units that you have in your local OS partition. Forget about seeing the true machine unless you are a hypervisor. The only exception to this rule today is in x86 land, but the end of non-virtual machines is coming fast...


C
Constantin

One more Windows recipe: use system-wide environment variable NUMBER_OF_PROCESSORS:

printf("%d\n", atoi(getenv("NUMBER_OF_PROCESSORS")));

t
tshepang

You probably won't be able to get it in a platform independent way. Windows you get number of processors.

Win32 System Information


Carefull: Hyperthreaded processors say there are two. So you also need to see if the processor are hyperthread capable.
C
Community

Windows (x64 and Win32) and C++11

The number of groups of logical processors sharing a single processor core. (Using GetLogicalProcessorInformationEx, see GetLogicalProcessorInformation as well)

size_t NumberOfPhysicalCores() noexcept {

    DWORD length = 0;
    const BOOL result_first = GetLogicalProcessorInformationEx(RelationProcessorCore, nullptr, &length);
    assert(GetLastError() == ERROR_INSUFFICIENT_BUFFER);

    std::unique_ptr< uint8_t[] > buffer(new uint8_t[length]);
    const PSYSTEM_LOGICAL_PROCESSOR_INFORMATION_EX info = 
            reinterpret_cast< PSYSTEM_LOGICAL_PROCESSOR_INFORMATION_EX >(buffer.get());

    const BOOL result_second = GetLogicalProcessorInformationEx(RelationProcessorCore, info, &length);
    assert(result_second != FALSE);

    size_t nb_physical_cores = 0;
    size_t offset = 0;
    do {
        const PSYSTEM_LOGICAL_PROCESSOR_INFORMATION_EX current_info =
            reinterpret_cast< PSYSTEM_LOGICAL_PROCESSOR_INFORMATION_EX >(buffer.get() + offset);
        offset += current_info->Size;
        ++nb_physical_cores;
    } while (offset < length);
        
    return nb_physical_cores;
}

Note that the implementation of NumberOfPhysicalCores is IMHO far from trivial (i.e. "use GetLogicalProcessorInformation or GetLogicalProcessorInformationEx"). Instead it is rather subtle if one reads the documentation (explicitly present for GetLogicalProcessorInformation and implicitly present for GetLogicalProcessorInformationEx) at MSDN.

The number of logical processors. (Using GetSystemInfo)

size_t NumberOfSystemCores() noexcept {
    SYSTEM_INFO system_info;
    ZeroMemory(&system_info, sizeof(system_info));
    
    GetSystemInfo(&system_info);
    
    return static_cast< size_t >(system_info.dwNumberOfProcessors);
}

Note that both methods can easily be converted to C/C++98/C++03.


@KeyWeeUsr Thanks Windows programming is somewhat far from trivial and logical. In the mean time, I use a slightly more updated C++17 version which is also more correct according to the static analyzer PVS-Studio with regard to some size_t casts. (Although, msvc++ does not complain at W4.)
M
Mysticial

More on OS X: sysconf(_SC_NPROCESSORS_ONLN) is available only versions >= 10.5, not 10.4.

An alternative is the HW_AVAILCPU/sysctl() BSD code which is available on versions >= 10.2.


t
tshepang

Unrelated to C++, but on Linux I usually do:

grep processor /proc/cpuinfo | wc -l

Handy for scripting languages like bash/perl/python/ruby.


For python: import multiprocessing print multiprocessing.cpu_count()
It's been a long time, but grep has -c flag to count entries!
It's been a long time, but my Raspberry Pi has model name : ARMv6-compatible processor rev 7 (v6l) in its cpuinfo, so one probably out to use grep -c ^processor /proc/cpuinfo
C
Chris Ballance

Windows Server 2003 and later lets you leverage the GetLogicalProcessorInformation function

http://msdn.microsoft.com/en-us/library/ms683194.aspx


A
Akhil

hwloc (http://www.open-mpi.org/projects/hwloc/) is worth looking at. Though requires another library integration into your code but it can provide all the information about your processor (number of cores, the topology, etc.)


t
tshepang

On linux the best programmatic way as far as I know is to use

sysconf(_SC_NPROCESSORS_CONF)

or

sysconf(_SC_NPROCESSORS_ONLN)

These aren't standard, but are in my man page for Linux.


P
P.P

On Linux, it's may not be safe to to use _SC_NPROCESSORS_ONLN as it's not part of POSIX standard and the sysconf manual states as much. So there's a possibility that _SC_NPROCESSORS_ONLN may not be present:

 These values also exist, but may not be standard.

     [...]     

     - _SC_NPROCESSORS_CONF
              The number of processors configured.   
     - _SC_NPROCESSORS_ONLN
              The number of processors currently online (available).

A simple approach would be to read /proc/stat or /proc/cpuinfo and count them:

#include<unistd.h>
#include<stdio.h>

int main(void)
{
char str[256];
int procCount = -1; // to offset for the first entry
FILE *fp;

if( (fp = fopen("/proc/stat", "r")) )
{
  while(fgets(str, sizeof str, fp))
  if( !memcmp(str, "cpu", 3) ) procCount++;
}

if ( procCount == -1) 
{ 
printf("Unable to get proc count. Defaulting to 2");
procCount=2;
}

printf("Proc Count:%d\n", procCount);
return 0;
}

Using /proc/cpuinfo:

#include<unistd.h>
#include<stdio.h>

int main(void)
{
char str[256];
int procCount = 0;
FILE *fp;

if( (fp = fopen("/proc/cpuinfo", "r")) )
{
  while(fgets(str, sizeof str, fp))
  if( !memcmp(str, "processor", 9) ) procCount++;
}

if ( !procCount ) 
{ 
printf("Unable to get proc count. Defaulting to 2");
procCount=2;
}

printf("Proc Count:%d\n", procCount);
return 0;
}

The same approach in shell using grep:

grep -c ^processor /proc/cpuinfo

Or

grep -c ^cpu /proc/stat # subtract 1 from the result

g
gauss256

OS X alternative: The solution described earlier based on [[NSProcessInfo processInfo] processorCount] is only available on OS X 10.5.0, according to the docs. For earlier versions of OS X, use the Carbon function MPProcessors().

If you're a Cocoa programmer, don't be freaked out by the fact that this is Carbon. You just need to need to add the Carbon framework to your Xcode project and MPProcessors() will be available.


i
irrlicht_ist_toll

For Win32:

While GetSystemInfo() gets you the number of logical processors, use GetLogicalProcessorInformationEx() to get the number of physical processors.


J
Jonathan Leffler
#include <stdint.h>

#if defined(__APPLE__) || defined(__FreeBSD__)
#include <sys/sysctl.h>

uint32_t num_physical_cores(void)
{
    uint32_t num_cores      = 0;
    size_t num_cores_len    = sizeof(num_cores);

    sysctlbyname("hw.physicalcpu", &num_cores, &num_cores_len, 0, 0);

    return num_cores;
}
#elif defined(__linux__)
#include <unistd.h>
#include <stdio.h>
uint32_t num_physical_cores(void)
{
    uint32_t lcores = 0, tsibs = 0;

    char buff[32];
    char path[64];

    for (lcores = 0;;lcores++) {
        FILE *cpu;

        snprintf(path, sizeof(path), "/sys/devices/system/cpu/cpu%u/topology/thread_siblings_list", lcores);

        cpu = fopen(path, "r");
        if (!cpu) break;

        while (fscanf(cpu, "%[0-9]", buff)) {
            tsibs++;
            if (fgetc(cpu) != ',') break;
        }

        fclose(cpu);
    }

    return lcores / (tsibs / lcores);
}
#else
#error Unrecognized operating system
#endif

This should return the number of physical cores on the system. This is different than the number of logical cores which most of these answers provide. If you're looking to size a thread pool which performs no blocking I/O, and doesn't sleep, then you want to use the number of physical cores, not the number of logical (hyper threading) cores.

This answer only provides implementations for Linux and the BSDs.


佚名

you can use WMI in .net too but you're then dependent on the wmi service running etc. Sometimes it works locally, but then fail when the same code is run on servers. I believe that's a namespace issue, related to the "names" whose values you're reading.