Getting rid of cavities?

No they will not go away with anything you can do by yourself. Yes if they are very small they may be able to be filled without the shot and by just using laughing gas. Ask the dentist. Tend to them as soon as possible while they are small.