You most likely have pericornitis which is an infection of the tissue around a tooth. It's very common in wisdom teeth, especially lower ones. It is often the result of food being trapped under the gum tissue. If you can find a way to flush the area out it might help make it feel better.
Getting the tooth taken out will be a more permanent solution.