I don't know about Canada, but since you mention kids sports referee, you could look into the local school systems. My school district has high demand for after school program leaders, coaches, etc., that they pay community members to lead them (not a lot, but something). Subbing is also in high demand, and there are programs to transition from a career into teaching (and usually have opportunities for part-time teachers). I've also heard of folks going into teaching online/community college classes and enjoying it.
But really, at 4% SWR already, you should figure out what you want to do, ask for it/start doing it, and then arrange finances afterwards. Don't become an Uber driver if you don't absolutely LOVE driving strangers around all day (similarly, don't get into working with kids if you don't like kids).