@Men in Black - I feel as though I've started in a similar position to you. A bit older than the normal referee starter, I've got an extensive history within the game (albeit as a coach more so than a player) and I've dived straight in to Open Age football.
It's been reassuring to read this thread, as like yourself, after 2 games I've been having my doubts. In my first game I was observed by my coach and I felt as though I had a decent game and I had some good feedback.
2nd game, and first entirely on my own, left me questioning myself. In terms of decisions I feel as though I was correct with most, no big decisions messed up. Only a few ins/outs corner/goal kick where I wasn't sure. The game was going alright until a couple of moments towards the end of the first half.
1. Away team player in attacking half, within playing distance of the ball, uses shoulder to barge off a home team defender. Of course this happened right in front of the home team officials and they were furious that I deemed it fair and shouted play on. From that moment on their 'coach' berated me for just about everything.
2. At an offside decision I had already started running towards the drop zone. Out of my earshot apparently something was said between offender (away team) and CAR (home teams). I had no idea what had gone on so I just went back and warned the offending player. The home team were extremely upset, to put it mildly, that I had only warned the player. At half time the home team CAR (also the club sec) approached me and he was one the angriest people I have ever met. He said that it was 'disgusting' that the opposition had got away with calling him an 'f'ing c...' and that I can 'stick my flag up my a...' How on earth am I meant to have done anything about it if I hadn't heard it?
To be honest from there on I lost my confidence, I didn't really have much control or authority over the game and just wanted it to be over. My decisions were okay. I cautioned an away player for dissent towards the end of the game which was the first card I've ever given out. in hindsight, I reckon I should have given another card for dissent earlier on in 2nd half, and the away team left back should have received a yellow for persistent fouling - I gave too many warnings. There were a couple of challenges that were borderline careless-reckless, I warned the players.
I put in a misconduct report on WGS regarding the half-time incident. I'm going to wrap on another layer of skin (I knew referees needed a thick skin but you don't realize it until you are in that position), forget about what was said and move on to the next game. On reflection, I think I've started 'too nice' as a referee and I need to stamp my authority a bit more. Use my cards and my whistle, that's what they're there for.