I have an AI project that I'm working on. I have a machine learning algorithm for a robot, but I want to train it in simulation first. The experimental design is: The robot has a camera, and can see its own hand. It then makes random sequences of motor actions, and creates a causal link between what it saw in its camera, and the random set of motor actions.
I want a setup similar to this: https://www.youtube.com/watch?v=T-c17RKh3uE1
What I want to know is, does the Blender game engine/python library give access to a camera and stream its input in real time, and is it possible to send motor sequences to a virtual arm? Or should I use a different tool? From the virtual camera, I don't require a raytracer, just having access to the pixel buffer is enough using, more over a high resolution isn't required, 1024x768 is plenty.
I can't test my models on a real arm/webcam due to funds. I am good with python, C and C++, I have written many export and mesh scripts for Blender, however I don't know how to set something like this up, or if it is possible. Any help/direction is greatly appreciated.