That is where the confidence comes in. Make what you believe to be the right decision and get on with the game
in my experience, if players see a hesitant referee when it come to decision making, they will play on the fact that the referee has seen to be hesitant