Q. Can you draw Social Security while working if you didn’t pay in 40 quarters but you reached full retirement age? A. No, you can’t. However, if you had 40 quarters, you could continue working and draw a Social Security benefit; and, if you had reached full Social Security retirement age (65 to 67, depending on your year of birth), you wouldn’t be subject to the annual earnings limit.