If running OpenCV on something as small as an ESP32 is possible, it is even easier to run on something orders of magnitude more powerful and yet still inexpensive, such as the Raspberry Pi.

The calibration code, as well as the Remote Client and ESP32 codes, are all there for your hacking pleasure. Its been a while since we have seen OpenCV in action like with the Motion Tracking ...