Do not calculate dirty rects when rendering is skipped