If you delay signing up for Medicare at 65, the so-called Initial Enrollment Period — to apply for Part B, which covers much of what we consider health care: doctor visits, tests, and other non-hospital services – you will have to pay permanently higher premiums. Such Part B mistakes appear to happen with some frequency.