Luxonis OpenCV AI Kits
Luxonis OpenCV AI Kits (OAK) are turn-key products that allow running with performant, spatial AI, and CV in minutes. These kits are built on DepthAI, which is an MIT-licensed open-source hardware, software, and AI-training suite based on the Myriad X. OAK-D is a spatial AI powerhouse, capable of simultaneously running neural inference (AI) and accelerated computer vision functions while providing depth from two stereo cameras and color information from a single 4K camera in the center. OAK-1 is the tiny-but-mighty 4K camera capable of running the same advanced neural networks as OAK-D, but in an even more minuscule form factor for projects where space and power are at a premium.
Features
- OAK-1 & OAK-D FEATURES
- OAK does all these AI and CV functions In arbitrary combinations thanks to the Gen2 DepthAI Pipeline Builder
- Neural Inference
- e.g. object detection, image classification, semantic segmentation, pose estimation, etc.
- Object Tracking
- Up to 20 objects with unique IDs
- WARP/DEWARP
- Support for additional lenses for fish-eye applications
- APRILTAGS
- Structured navigation
- H.264 AND H.265 Encoding (HEVC, 1080P & 4K Video)
- 3.125MB/s (tiny bandwidth) for 4K video
- JPEG Encoding
- 12MP Stills
- Feature Tracking
- Optical and Visual Inertial Navigation
- Motion Estimation
- Allows real-time background subtraction
- Edge Detection Harris Filtering
- MJPEG Encoding
- For easy Web streaming/etc.
- Neural Inference
- OAK does all these AI and CV functions In arbitrary combinations thanks to the Gen2 DepthAI Pipeline Builder
- OAK-1 SPECIFIC FEATURES
- Automatic Motion-based Lossless Zooming
- 12x lossless zoom with 720p output
- 6x lossless zoom with 1080p output
- 1.5x lossless zoom with 4K output
- Automatic Motion-based Lossless Zooming
- OAK-D SPECIFIC FEATURES
- Stereo Depth (Including Median Filtering)
- Extended disparity and subpixel possible for wider dynamic range
- 3D Object Localization
- Monocular AI with Stereo Disparity Depth
- Stereo AI (i.e. stereo neural inference) for small object/feature support
- Object Tracking IN 3D Space
- 3D Trajectory in real-time
- Enables motion statistics in meters
- Stereo Depth (Including Median Filtering)
Overview
Videos
Embedded AI for real products
OAK is a modular, open-source ecosystem composed of MIT-licensed hardware, software, and AI training. This allows for embedding the super-power of spatial AI plus accelerated computer vision functions into projects. OAK provides a single, cohesive solution that would otherwise require cobbling together disparate hardware and software components.
The OAK API is a fast way to get started in spatial AI. The OAK-1 module's single USB-C connector provides data and power. Go from unboxing the hardware to running an advanced image classifier in under a minute.
Free Neural Nets
Spatial AI Modes
There are two ways to use OAK-D to get Spatial AI results: Monocular Neural Inference fused with Stereo Depth and Stereo Neural Inference. The modes have strengths and weaknesses for specific use cases.
With the Monocular Neural Inference fused with Stereo Depth, the neural network is run on a single camera and fused with disparity depth results. The left, right, or RGB camera can be used to run the neural inference.
Stereo Neural Inference
When using Stereo Neural Inference the neural network is run in parallel on OAK-D's left and right cameras to produce 3D position data directly with the neural network.
In these cases, standard neural networks can be used. There is no need for the neural networks to be trained with 3D data. OAK-D automatically provides the 3D results in both cases using standard 2D-trained networks.