German video IP developer Videantis has just made public its unified vision and video coding solution for mobile, home and automotive applications.
The platform combines the company’s low-power, scalable v-MP4000HDX processor IP core family with an accelerated OpenCV library, and a suite of Full HD and 4K video encoders and decoders.
The v-MP4000HDX architecture scales from a three-core v-MP4120HDX subsystem with a single stream processor and two media processors to a ten-core v-MP4280HDX subsystem that includes two stream processors and eight media processors.
Available under license the platform is targeted at mobile, gaming and TV designs making use of augmented reality, gesture interfacing, depth mapping and computational photography . In automotive applications, the company’s low-delay, high dynamic range video codecs combined with computer vision techniques enable both camera-based advanced driver assistance systems and surround-view cameras to prevent collisions.
According to Hans-Joachim Stolberg, videantis’s CEO, all of these applications have one thing in common: they require a high-performance, low-power flexible video processing subsystem such as the v-MP4000HDX to run the computationally demanding algorithms that can extract meaning from the images the cameras capture, without draining the battery. This same architecture, he said, also supports video compression and decompression, so that the system can simultaneously decompress, analyze and compress video data.
“We optimized the widely used OpenCV library for our v-MP4000HDX architecture and combined it with our video codecs, so they’re able to run concurrently, said Stolberg. “In addition, we took great care in optimizing both the hardware and software for low-power operation, which is of course important for mobile applications, but also a major factor for embedded applications.”
The v-MP4180HDX subsystem performs 192 16-bit pixel operations per cycle, 24 on each of its eight two-issue VLIW media processors. This subsystem is under 2mm2 of silicon in 28nm technology, including memories.
With four media processors, the v-MP4140HDX subsystem performs 96 16-bit pixel operations per cycle. This subsystem is under 1mm2 of silicon in 28nm technology, including memories. Thanks to its flexible architecture, he said, the subsystem can run video codecs, imaging, computer vision, and computational photography algorithms all simultaneously.
The v-MP4000HDX accelerates OpenCV, the de facto standard for open computer vision libraries. OpenCV has been downloaded over 3 million times and is widely used in both academia and industry.
“Using OpenCV, algorithm development can take place in a standard PC-based environment,” said Stolberg. “Once algorithm development and testing are completed, the application can seamlessly be migrated toward an embedded videantis-enabled platform where the OpenCV function calls are accelerated by the v-MP4000HDX subsystem.
“This acceleration results in a speedup of more than 100x compared to running on the host CPU, and power consumption that’s 1000x lower. This way the v-MP4000HDX supports full HD processing, allowing for more accurate algorithms and an overall higher-quality user experience.”
Besides running computer vision algorithms, the v-MP4000HDX supports about a dozen of the most popular video codec specifications running at Full HD or 4K resolution for decode and Full HD for encode. And because the subsystem is software programmable, additional coding standards can run on the same silicon. The v-MP4000HDX can be firmware upgraded to run H.265/HEVC, VP9 or high dynamic range still image codecs, for example.
A development and evaluation system is available that includes a 40nm implementation of the v-MP4280HDX processor at 400MHz, a 1GHz ARM host CPU, camera input, HDMI output and networking.