Skip to content

About

AI simulation is the cohort of software tools we have built at Meta for modeling and simulation of AI clusters including but not limited to PackSim, which is a packet-level AI network simulator generating various performance metrics like collective completion times, link utilizations, dropped packets, as a function of AI workloads and topologies.

Resources

Code of conduct

Contributing

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

AI Simulation

linux

This repository holds tools Meta uses to simulate the backend networks that carry AI training and inference traffic. Training a large model is bounded as much by the fabric between the accelerators as by the accelerators themselves, and the questions that matter — how a topology behaves under a given collective, where a buffer overruns, what a congestion-control change actually buys — are easier to answer in simulation than on hardware that has not been built yet. We are sharing the tools we use to answer them.

Projects

  • packsim — a packet-level, discrete-event simulator for AI training fabrics. Models endpoints, NICs, RoCEv2 transport, switches and links, and reports how long a collective takes and where the time went.

Contributing

Read CONTRIBUTING.md first — how changes reach this repository is unusual. It is generated from a directory inside Meta's internal monorepo, so a pull request here is never merged: if we take the change, a Meta engineer applies it internally and it arrives on the next export, with you credited. The marker comments you will see in the sources are load-bearing and should be left alone; CONTRIBUTING.md explains them.

Participants are expected to follow our Code of Conduct.

License

PackSim is licensed under the BSD 3-Clause License, as found in the LICENSE file. build/fbcode_builder/, Meta's shared build tooling, has its own licence terms: see its LICENSE and the headers of its files.

About

AI simulation is the cohort of software tools we have built at Meta for modeling and simulation of AI clusters including but not limited to PackSim, which is a packet-level AI network simulator generating various performance metrics like collective completion times, link utilizations, dropped packets, as a function of AI workloads and topologies.

Resources

Code of conduct

Contributing

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages