Frequently Asked Questions

Version 28 (Kwabena Agyeman, 03/15/2012 10:10 pm)

1 1 Kwabena Agyeman
h1. Frequently Asked Questions
2 1 Kwabena Agyeman
3 12 Kwabena Agyeman
h3. *What is unique about the CMUcam4?*
4 3 Kwabena Agyeman
5 3 Kwabena Agyeman
Traditionally fast computers are needed to capture and process camera images. It is also necessary to write the software to perform this processing. Because of this it is difficult to use vision as a sensor in simple systems.
6 3 Kwabena Agyeman
7 3 Kwabena Agyeman
The CMUcam4 vision system uses a fast low cost microcontroller to handle all of the high speed processing of the camera data and contains software to perform simple vision tasks. Because the user can choose to output only low bandwidth high level information from the vision system, like the red object is at position X-Y, it is possible for a simple processor like a Arduino or BASIC Stamp 2 microcontroller to read this data and direct a small robot in tasks like chasing a colored ball. The CMUcam4 vision system makes it possible to ignore the complexity of camera interfacing and use vision just like any other sensor (i.e. sonar) often used in robotic systems.
8 3 Kwabena Agyeman
9 10 Kwabena Agyeman
Additionally, with new TV output functionality, you can see what the CMUcam4 sees on the TV to verify that everything is working!
10 3 Kwabena Agyeman
11 13 Kwabena Agyeman
h3. *What is the CMUcam4's frame rate?*
12 3 Kwabena Agyeman
13 3 Kwabena Agyeman
The frame rate is 10 frames per second. This means CMUcam4 can tell you the position of an object 10 times per second. Using the serial software protocol you can slow this down if desired.
14 3 Kwabena Agyeman
15 3 Kwabena Agyeman
h3. *What baud rates does the CMUcam4 support?*
16 3 Kwabena Agyeman
17 9 Kwabena Agyeman
The CMUcam4 can communicate at any baud rate selected via the serial software protocol. The default baud rate after the CMUcam4 resets is 19,200 bits per second.
18 3 Kwabena Agyeman
19 3 Kwabena Agyeman
h3. *How do I upgrade my CMUcam4 firmware?*
20 3 Kwabena Agyeman
21 3 Kwabena Agyeman
Please see the [[firmware]] wiki page.
22 3 Kwabena Agyeman
23 14 Kwabena Agyeman
h3. *Does the CMUcam4 work outside?*
24 3 Kwabena Agyeman
25 3 Kwabena Agyeman
The CMUcam4 works outside but not in direct sunshine. It is possible to add an external filter to improve outdoor operation.
26 3 Kwabena Agyeman
27 15 Kwabena Agyeman
h3. *Can I write custom code for the CMUcam4?*
28 3 Kwabena Agyeman
29 3 Kwabena Agyeman
Please see the [[firmware]] wiki page.
30 3 Kwabena Agyeman
31 16 Kwabena Agyeman
h3. *How much power does the CMUcam4 consume?*
32 3 Kwabena Agyeman
33 11 Kwabena Agyeman
The complete system consumes about 100 milliamperes.
34 3 Kwabena Agyeman
35 17 Kwabena Agyeman
h3. *What is the CMUcam4's field of view?*
36 3 Kwabena Agyeman
37 3 Kwabena Agyeman
About a 25 degree field of view, which is relatively narrow.
38 3 Kwabena Agyeman
39 18 Kwabena Agyeman
h3. *What processor does the CMUcam4 use?*
40 3 Kwabena Agyeman
41 3 Kwabena Agyeman
Please see the [[firmware]] wiki page.
42 3 Kwabena Agyeman
43 19 Kwabena Agyeman
h3. *What CMOS camera does the CMUcam4 use?*
44 3 Kwabena Agyeman
45 3 Kwabena Agyeman
Please see the [[firmware]] wiki page.
46 3 Kwabena Agyeman
47 20 Kwabena Agyeman
h3. *Does the CMUcam4 work with other CMOS cameras?*
48 3 Kwabena Agyeman
49 5 Kwabena Agyeman
No. Currently the hardware and software system have been designed to work specifically with the "OmniVision":http://www.ovt.com/ "OV9665":http://www.ovt.com/products/sensor.php?id=5 CMOS camera. The system would need to be completely redesigned to work with another camera.
50 3 Kwabena Agyeman
51 3 Kwabena Agyeman
h3. *Is there some place I can find answers to additional questions I have?*
52 3 Kwabena Agyeman
53 21 Kwabena Agyeman
Yes. Please visit the forums "here":/projects/cmucam4/boards.
54 3 Kwabena Agyeman
55 3 Kwabena Agyeman
h3. *Where can I find out more about computer vision in general?*
56 3 Kwabena Agyeman
57 3 Kwabena Agyeman
The CMUcam4 performs the simple computer vision task it was designed to perform in a small, inexpensive package. However, the general computer vision problem of trying to recognize arbitrary objects under arbitrary conditions is still a very active research topic and very far from being anywhere near a solved problem.
58 3 Kwabena Agyeman
 
59 3 Kwabena Agyeman
If you want to learn more about computer vision, you might want to try these links: 
60 3 Kwabena Agyeman
61 4 Kwabena Agyeman
* "The On-Line Compendium of Computer Vision":http://www.dai.ed.ac.uk/CVonline/ 
62 4 Kwabena Agyeman
* "The Computer Vision Home Page at CMU":http://www.cs.cmu.edu/~cil/vision.html
63 22 Kwabena Agyeman
64 22 Kwabena Agyeman
h3. *What is the exact sequence of steps performed on power up by demo mode?*
65 22 Kwabena Agyeman
66 25 Kwabena Agyeman
This is the exact sequence that demo mode performs on power up:
67 22 Kwabena Agyeman
68 27 Kwabena Agyeman
#  Reset the camera. 
69 27 Kwabena Agyeman
#  Wait 5 seconds for the camera parameters auto adjustment to stabilize.
70 28 Kwabena Agyeman
#  Select YCbCr mode and turn off auto gain and white balance. 
71 27 Kwabena Agyeman
#  Execute the "TW" (Track Window) command.
72 22 Kwabena Agyeman
73 25 Kwabena Agyeman
After which, the camera will begin to drive a servo towards the middle mass of the color detected by the "TW" (Track Window) command.
74 23 Kwabena Agyeman
75 23 Kwabena Agyeman
h3. *What is the exact sequence of steps performed by the "TW" command?*
76 23 Kwabena Agyeman
77 24 Kwabena Agyeman
This is the exact sequence of steps that the "TW" (Track Window) command performs: 
78 23 Kwabena Agyeman
79 23 Kwabena Agyeman
#  Shrink the window to 1/4 the size (in each dimension) of the current window to a new window centered at the current window center.
80 24 Kwabena Agyeman
#  Get all the channel means.
81 23 Kwabena Agyeman
#  Restore the window to the full image size. 
82 24 Kwabena Agyeman
#  Set the max and min value for each color channel to be the mean for that channel +/- the user supplied threshold for each channel.
83 23 Kwabena Agyeman
84 24 Kwabena Agyeman
After which, the camera will begin to stream Type F, S, and/or T packets.