The word buff, among other more nefarious terms, is a color which is often associated with the color of tanned hide or just hide.  A color that might have been used on WW2 bombers.  Not saying it was used  during WW2 just a possibility that buff was associated with bombers with a particle type of camouflage color.