If, in your opinion, it was a goal, then it was a goal.
You may doubt yourself, and we all do sometimes, but I suspect the reason your confidence feels low is because you allowed the manager to dictate the decision.
There will always be cases where the reaction of others makes you second...