I went through something sort of similar, sans-marriage. My ex boyfriend was living with me in a house that I owned and refusing to leave.
My friend predicted this might happen and offered to serve the first round of eviction-related papers for me,which I took him up on and he did shortly after the breakup. (This was the "your landlord no longer wants to rent to you and you have 30 days to leave before beging evicted" paper. It has to be served, as in hand delivered, by someone other than the landlord, in my state.) 30 days was the legal minimum. Rent money didn't become an issue because he hadn't been contributing financially anyway.
My ex was really obnoxious and hard to live with for around two weeks, finding an excuse to come talk to me every day and then turn it into either a "pity me and let me stay and/or give me money for my invented emergency*" conversation or acting threatening. Even though I was living off microwaved soup in the upstairs of the house only to avoid his bedroom and the kitchen which were downstairs. I stayed in a hotel for a few days towards the end - I know it's not the cheapest option but worth it for mental health. Luckily, ex got himself a train ticket back to his parents' town and left of his own accord.
If he'd been violent it might have been possible to get him out faster through family court (I'm not sure if emotionally abusive and threatening is enough to count, it might be), but I didn't explore that route much.
He didn't steal anything when he left, but he did leave behind the mattress I'd bought for him to use and pepper spray it before leaving. It was nicer than mine, so a couple months later I tried using it and woke up with my eyes burning. So that sucked.
If ex fought the eviction, I'd probably have needed to decide up the house somewhat for my own sanity. Extra locked door at the top of the stairs or something. I really don't know how that would have gone.
*
One of the invented emergencies was that he had no food. The freezer was full of chicken and frozen veggies. He made baked chicken for himself frequently. It wasn't "hey, I'm unemployed (because I refuse to apply for jobs) so can I still eat the shared food while I'm here?" it was "please give me cash or take me shopping and pay for everything".