Indeed that’s what R Yudah Chasid wrote, and Mishna Berura brings it siman 260. But lemaase if you forgot to shave yesterday you can today, especially according to Chacham Ovadia.