Don't lose the fontDef when setting the size of a raw font.