Personal AI Router , or PAIR, connects multiple devices on the same local network.
Nvidia bills PAIR as the means to build “a personal home AI cluster,” with the software capable of routing independent inference requests to an available system.
Nvidia is pushing its networking prowess further into the local AI space with a software tool allowing developers to interconnect MacOS, Windows, and Linux systems.
It works across systems housing Nvidia RTX GPUs and its lunchbox-sized desktop AI supercomputer line, DGX Spark.
Windows devices need to be running Windows 11, while Apple systems need MacOS Tahoe.
Personal AI Router , or PAIR, connects multiple devices on the same local network. Nvidia bills PAIR as the means to build “a personal home AI cluster,” with the software capable of routing independent inference requests to an available system.
Nvidia is pushing its networking prowess further into the local AI space with a software tool allowing developers to interconnect MacOS, Windows, and Linux systems.
It works across systems housing Nvidia RTX GPUs and its lunchbox-sized desktop AI supercomputer line, DGX Spark. MacOS systems that are compatible with Nvidia’s offerings can employ PAIR to route local AI inference workloads to other machines on the network.
The virtual inference router routes workloads, while platforms like Ollama or LM Studio run the model on the machine the software selects. An Nvidia technical blog describes how it works: “PAIR discovers participating systems, tracks whether each system is ready for a request, schedules independent jobs, and returns each response to the application that originated it.”
Nvidia stressed that its newest software offering differs from a custom routing script with glossy green paint smeared over it in that it distributes workloads while keeping them secure. Where routing raw tokens across a home network creates security vulnerabilities, Nvidia contends PAIR employs mutual Transport Layer Security (mTLS) for encryption, while users employ a six-digit PIN between nodes, with the cluster refusing a machine that is not a member.
No fancy data center-esque cables are required to use it, with the software tool itself open source, so anyone can use it.
It does require a minimum of eight gigabytes of RAM to run, but does not need to be connected to the internet during operation. Windows devices need to be running Windows 11, while Apple systems need MacOS Tahoe. For Linux systems, PAIR needs a distro like Ubuntu 14.04 to run. At the time of writing, it’s only available in English.
