NVIDIA Holoscan

NVIDIA Holoscan is the AI sensor processing platform that combines hardware systems for low-latency sensor and network connectivity, optimized libraries for data processing and AI, and core microservices to run streaming, imaging, and other applications, from embedded to edge to cloud. It can be used to build streaming AI pipelines for a variety of domains, including Medical Devices, High Performance Computing at the Edge, Industrial Inspection and more.

The Holoscan platform consists of:

Software

• Holoscan SDK: the Software Development Kit
  • User guide (PDF)
  • Development container
  • Debian package
  • Python wheel
  • Source code
• HoloHub: community-driven collection of Holoscan applications, operators, and tutorials
  • Website
  • Source code
• Deployment Software Stack: OpenEmbedded/Yocto layer for optimized deployment of the Holoscan SDK on the Developer Kits
  • OpenEmbedded/Yocto Build container
  • OpenEmbedded/Yocto Recipes
• Holoscan Sensor Bridge Software: integrate the Holoscan Sensor Bridge Device in a Holoscan Application
  • Source code
  • Documentation

Hardware

Developer Kits

• NVIDIA IGX Orin Developer Kit (User guide)
• NVIDIA Clara AGX Developer Kit (User guide)
• NVIDIA Jetson Orin Developer Kits (User Guide)

Sensors

• Holoscan Sensor Bridge Reference Design: bring your own sensor, and leverage this FPGA design to send packets over Ethernet, including RDMA support when connected to the ConnectX NIC of a NVIDIA Developer Kit.
• AJA Capture Cards: achieve RDMA through these PCIe capture cards using the AJA drivers and Holoscan operator (Documentation/Operator).
• Emergent Vision Tech High-Speed Cameras: achieve RDMA through the ConnectX NIC using the Rivermax SDK and the Emergent Holoscan operator (Documentation/Operator).

Additional Tools

• Holoscan Test Suite: support Verification and Validation testing on Holoscan Developer Kits
• Holoscan Perf Tools: collection of tools to help measure performance of the Holoscan platform (software and hardware)

Note

In previous releases, the prefix Clara was used to define Holoscan as a platform designed initially for medical devices. As Holoscan has grown, its potential to serve other areas has become apparent. Starting with version 0.4.0 of the Holoscan SDK, Holoscan is now officially built to be domain-agnostic and can be used to build sensor AI applications in multiple domains. Going forward, domain specific content will be hosted on the HoloHub repository.