wisdom teeth?

I have a question about the healing process. The bottom jaw, where the two wisdom teeth that came out in pieces, is still swollen after 3-4 days after the surgery. The places where it's still swelling and sore is very warm, like I am running a fever in my jaw, if that makes any sense whatsoever. The two sockets in the bottom jaw feel very irritated. It's NOT like something cold running over exposed nerves or raw bone, just irritated. At night, I run very cold to very hot, and in both extremes, I can never get comfortable.

My top jaw and sockets feel just fine, like nothing happened there really. They still need to heal some but it's not too bad.

I am eating very soft foods like mashed potatoes, apple sauce, and pudding but the bottom jaw is just now starting to act up.

Should I call the oral surgeon tomorrow when they're open and tell them what's going on? Or is it that serious?