I used to do bookkeeping work for a small non-profit with only one paid employee (not me). Payroll was a manually written check with the deductions withheld and quarterly filings with state/fed to pay withheld taxes. Federal, I used to call a phone number and make the payment thru the EFTPS. State was an online filing debited from the checking account.