Thanks all
He accused me of "repeatedly" stepping out and making cell phone calls and billing the time back to him, and of going over the agreed-upon number of hours (which I did on occasion, but only at his request). He literally watched my time in five-minute increments.
Meantime,
he breached the contract by repeatedly paying me late. He never once paid me on time.

Though usually he paid me within a week of the due date, so I didn't make a big deal out of it.
Well, I'm better off

I've got some plans to start up my own business, and in the meantime, I still have some unemployment benefits coming to me. I've also got a call in to my lawyer - we'll see if anything comes of that.
Moving forward...