You could check with your permit office. It could be as part of closing out the permit, they perform their own survey. It could be someone complained about your fence. It could be yours was the most recent survey someone is using as a starting off point for their own survey. Did you see someone, or just flags?