Going to the Olympics is awesome, so long as you don't mind spending a little. Personally, I think the cost is worthwhile, and I have amassed a wealth of incredible Olympic memories..... More than many athletes who have competed haha.
I was working in Sydney in 2000, and through my job scored a number of invites to events. I supplemented this with some ticket purchases of my own and we went to the "free" events like the marathon and road race. We also partied hard in the city for the entire games, and generally had an amazing time. Sydmey has never been the same before or since. I was badly bitten by the Olympic bug.
In 2004 we managed to find ourselves as part of the Olympic torch relay, which passed through Sydney. My wife and I were lucky to be invited to row a torch bearer up the river for a couple of Kms as the sun set. Being a part of the torch relay was Another memorable Olympic moment that has shaped my love of the Olympics.
Then in 2012 a friend in London invited us to stay at their house for the Olympics. I took up the offer and bought a bucket load of tickets. I think we went to about 13 events, but as we weren't paying for accommodation I didn't mind splashing out on tickets. We spent about $500 per ticket to go to one night of the athletics, which was incredible. We deliberated hard before spending $1,000 on 3 hrs entertainment, but in hindsight we are glad we spent the money. The rest of the tickets were far cheaper. Besides athletics we went to all manner of sports i.e.: judo, weightlifting, track cycling, rowing, basketball, football, gymnastics, beach volleyball, indoor volleyball etc. one day we went to 3 events in different corners of London. We had a ball!
After London I was so addicted to the Olympics that I decided to go to Sochi for the Winter Olympics in 2014. Again I purchased a large wad of tickets to every conceivable event, and again we had a wild time, with maybe a little too much vodka. We were able to keep the cost down for Sochi by staying on a cruise ship on the Black Sea, which came all inclusive with meals. It was a great deal. I think I spent about $3,000 in total event tickets for the 2 of us to go to about 10-12 events.
All 3 Olympics I have attended were really memorable times, that I know I will always look back on fondly. I plan to be well and truly fired before the Tokyo 2020 Olympics and would love to attend, if we can find a way to keep the cost sensible. I have a couple of friends living in Tokyo, so fingers crossed they might open their doors to an Olympic junkie.