This thesis describes the methods and realization of embedded real time vision systems for mobile robotics with a focus on stereo vision.
Computer vision algorithms are often computationally expensive, especially stereo vision and optical flow calculation which demand a high amount of computing power. Therefore, computers performing those tasks tend to have high power consumption and large physical size, both of which are often constrained in mobile robotics. In order to solve this problem I have developed several embedded systems that are able to perform stereo vision and optical flow computation with low power consumption. These systems are small enough to fit into most of the mobile robots being used in robotics research today. The six main contributions of my thesis are:
My systems have been successfully tested with the autonomous cars "E-instein" and "Made in Germany". Both cars rely on the SAFEBox for safe drive-by-wire operation. "Made in Germany" uses my vision preprocessor for stereo vision and optical flow computation.
Moreover, the results of this thesis are not limited to controlling autonomous cars. They can be applied to mobile robotics in general. A centralized, eight-camera system for 360 degree surround view applications has also been developed. Furthermore, the development of a miniaturized Smart Stereo Camera has opened up new areas of applications, allowing the integration of the system into humanoid soccer robots, autonomous wheelchairs and the autonomous model cars developed at the Free University of Berlin.