Don't sweat it, and don't get attached to this particular house. Take your time and you'll eventually find the right house. Buying a house isn't something to rush.
First things first: Dump your current agent. Some agents are terrible, others are great. Sorry, sounds like you had a bad one. If you can, get a recommendation from someone you trust in the area. But always keep one thing in the back of your mind: agents on both sides of the transaction only get paid if the deal closes, so take everything they say with a big grain of salt.
Your second order of business is to immerse yourself in the market you're interested in. Learn the neighborhoods, parks, schools, traffic patterns, crime, and so on. Where do people want to live? What does an older 3/2 sell for vs. new construction in the same neighborhood? How much value does off-street parking and/or a garage add? And also, how hot is each area, time on market, under/over asking, and so on. You need to do your homework or you risk both overbidding and missing good deals because you're racked with doubt.
Finally, get an inspection. Like agents, some inspectors are great and some are not. Again, get recommendations from people you know and trust if possible. But don't rely exclusively on an inspection, also check things out for yourself. Inspect the condition of the roof and basement/foundation, age of major mechanical systems (water heater, HVAC), look for water intrusion along ceilings and along windows and around door frames, look for damaged/soft trim and siding, and so on. These are all easy and quick to check. Your inspector should find these plus a lot more. If they miss the easy stuff then you got a dud.
Finally, a note about something someone else mentioned up thread: When selling a house I like to hire a good and detailed inspector before going on market. This, plus a pest inspection, usually ends up running about $1000. But it's worth it, and I want the inspector to do a thorough job because my goal is to disclose as much as possible before people write offers. Two reasons for this. First, ethically and legally, I don't want any unpleasant surprises after a transaction -- it's not worth the trouble. Second, this greatly reduces the amount of contingencies and resulting negotiation. Of course people are encouraged to do their own inspections, but they can't easily put a contingency on something previously disclosed. Don't know if this is common in your area, but if it is, read those reports (and all the others) and disclosures carefully. They can run 100 pages, but just do it.