Presented by the tinyML Foundation: Running and Managing Fleets of Single Board Computers at Scale.
The increase of compute power available on single board computers (SBCs) has opened the door to a whole new class of ML-powered applications that can run on the likes of a Raspberry Pi or a Jetson Nano. In this talk, we explore the different architectures for running ML models on large fleets of SBCs. We start by discussing the benefits and challenges of running ML at the edge, including reducing latency, improving privacy, and reducing bandwidth requirements. We then delve into different architectures for running ML on fleets of these devices and explore the advantages and potential pitfalls of implementing each. Finally, we walk through several different demos to contextualize how these architectures can be used to power real-world ML enabled solutions, including NLP, computer vision, and sensor data monitoring.
About Modzy
Deploy and scale production machine learning in minutes. Modzy is the platform to deploy, connect, and run machine learning models in the enterprise and at the edge, with fully managed infrastructure, tools, and workflows.
Get a demo of the platform and see unmatched features for MLOps, explainability, enterprise security, infrastructure cost management, and powerful integrations.
Recent Comments