Don't cache colorMap pointer.