Congrats! DH and I also continued to live like students after graduation, so I often recommend this method of preventing lifestyle inflation upon having a higher income.
I took a look at DH's and my budget from back in 2010 when we had just finished school. It's virtually the same as now. You're going to have variations on these, but hoping this will help:
Housing
-rent
-renter's insurance
-utilities like electric, gas, water, garbage
-internet connection (likely you'll want this if you don't have cable television plus homework needs)
-cell phone plan
Food
-groceries
-restaurants/coffee (probably a small portion of your budget)
Car (you may not have this)
-gas/oil
-maintenance
Amuseument
-Netflix or other streaming service
-concert tickets or other fun things
Clothing
-laundry (some rentals have laundry in-unit, some have it down the hall for $1 or $2/load, or you'll be going to the Laundromat)
-we budgeted some money to grow our professional wardrobe - you may or may not need this
Financial
-debt
-savings
-life insurance (as a married couple, we wanted this coverage, but it may not make sense for your situation, or your university may offer some level of coverage that would at least pay for your funeral if the worst happened)
I'd also recommend building a small cushion of funds (maybe just a month's worth of minimum expenses like rent, food, utilities) before paying off any debt. Some people call this an emergency fund, I just keep this amount in checking in case money stops flowing in for some reason (payroll can get messed up and direct deposit can be delayed, etc.). Then I'd see how much you actually spend each month in various categories (use Mint.com or some other tracking system for your expenses) and then throw everything extra at your student loans.