> For the complete documentation index, see [llms.txt](https://xzhu0027.gitbook.io/blog/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://xzhu0027.gitbook.io/blog/ml-system.md).

# Systems for ML

- [Index](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index.md)
- [A Berkeley View of Systems Challenges for AI](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/a-berkeley-view-of-systems-challenges-for-ai.md): https://arxiv.org/pdf/1712.05855.pdf
- [Tiresias: A GPU Cluster Managerfor Distributed Deep Learning](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/tiresias-a-gpu-cluster-managerfor-distributed-deep-learning.md): https://www.usenix.org/system/files/nsdi19-gu.pdf
- [Gandiva: Introspective Cluster Scheduling for Deep Learning](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/gandiva-introspective-cluster-scheduling-for-deep-learning.md): https://www.usenix.org/conference/osdi18/presentation/xiao
- [Workshop papers](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/workshop-papers.md)
- [Hidden Technical Debt in Machine Learning Systems](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/hidden-technical-debt-in-machine-learning-systems.md)
- [Inference Systems](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/inference.md)
- [Parameter Servers and AllReduce](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/parameter-servers.md)
- [Federated Learning at Scale - Part I](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/towards-federated-learning-at-scale-system-design.md)
- [Federated Learning at Scale - Part II](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/federated-learning-at-scale-part-i.md)
- [Learning From Non-IID data](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/learning-from-non-iid-data.md)
- [Ray: A Distributed Framework for Emerging AI Applications](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/ray-a-distributed-framework-for-emerging-ai-applications.md): https://www.usenix.org/system/files/osdi18-moritz.pdf
- [PipeDream: Generalized Pipeline Parallelism for DNN Training](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/pipedream-generalized-pipeline-parallelism-for-dnn-training.md): https://cs.stanford.edu/~matei/papers/2019/sosp\_pipedream.pdf
- [DeepXplore: Automated Whitebox Testingof Deep Learning Systems](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/deepxplore-automated-whitebox-testingof-deep-learning-systems.md): http://www.cs.columbia.edu/~junfeng/papers/deepxplore-sosp17.pdf
- [Distributed Machine Learning Misc.](https://xzhu0027.gitbook.io/blog/ml-system/sys-ml-index/misc-1.md): Short summaries
