I get happy people being annoying at times. I have been there a few times, especially trying for my second child and everyone in my parent group had one straight away and it took me 4 years. I had to leave the group because as much as I was happy for them I couldn't stand it.
I am not interested in sport at all. I have never seen a rugby game and have no idea about anything that goes on. The only sport I watch is my 3 year old in soccer.
Did you ever play Magic the Gathering? A lot of games shops run Friday night games and some do on weekends. I want to go but can't because of the kids and my ill health. Most Game Traders run them, sometimes EB Games and if you are up to travel a little Top Ryde Good Games does. They have a facebook site and post their events. They offer to teach the game if you don't know how. It a terrific game. I have signed up for the notifications but can never go. Dreaming I guess. It might be a good place to meet other great nerdy people. You may even be able to find a rpg club. Games Paradise in the city has things too.
It seems impossible sometimes to get back into things but it is rewarding when you do.
There are also workshops that the councils run periodically on different things if you check your local council webpage. You might find something interesting on there.
It's great you get to the gym. I have never been a gym person but I did zumba before I became injured and I liked that as I like dancing.
Hope you don't mind all the suggestions. I know what lonely feels like. I lived on my own for a few years in a state I didn't know anyone. I ended up making friends out of a local newspaper of people looking for friends! Are there online groups of people looking for friends?
Have you been to Comic Con here? I went 2 years ago just after my injury dosed up on pain meds but couldn't miss it. I met William Shatner...that was a highlight.