Have you had any more information regarding this from your doctor/ENT?
I have done some research and from what I have read if the swelling is under 1CM in diameter then you're safe otherwise go to the doc and have it checked out.
I have something similar and am going to get it checked out next week.