If it doesn't let you delete the "Microsoft Authenticator" for your old device and this red error message pops up you will need to change your default sign in method from your app to your phone number. If this error doesn't pop up you may skip to step 16.