No Frills or Food Basics, or an ethnic supermarket.
Are you from the US? Getting a Cdn bank account or not? If not get a credit card and debit card that have low or no forex fees. Cap One Quicksilver is a good Visa credit. Alliant Credit Union charge 1% forex for ATM withdrawals I believe, and reimburse ATM fees up to $20 a month.