Currently the objects are being recognized based mainly on grayscale information, also known as the intensity or luminance component.
In many use-cases using all color components would not help. In some cases, in uncontrolled lighting conditions full color may harm the recognition. Also, using luminance helps us keep the response times low. But w