Dont get over concerned over first game.
In short from what I take from your post, do not care one iota about blowing the whistle too much, if thats what it takes to keep control then do it......if I get shouts from players telling me am giving too many fouls, I simply shout back "am yet to foul anyone, you stop fouling, I will stop blowing"
You are not there to control the quality of the game on show, as much as we all love a fast free flowing game
In the very early stages of a ref career, keep it simple, if you see a foul, give it.
Not meaning to be harsh, but it does read like you did not have control, and this lead to more damming issues later on.....go back out next time and tighten up from the very start.....you might just find a better conclusion..