You can explain it but not everyone will hear you, whereas everyone will see you pointing at the ball and not giving a free kick. It is poor and outdated practice, dating back to when winning the ball pretty much meant you could do anything after, and most observers are going to pick you up on it these days.Avoiding becoming "LWR" is about making the correct LOTG decision and explaining it correctly.
Saying this is the exception where we should be trying to obfuscate the correct reason for a decision because at some point in the future, some player might misrepresent that decision to a different official is putting too much of a burden of responsibility in the wrong place.
If a player says "well 2 weeks ago I did exactly that challenge and the ref didn't blow for it" then I'll treat it with a pinch of salt and use the same response I would if he told me another ref had let him play without shinpads, or wearing a ring or any other number of things relating to previous officials - I wasn't there, I wasn't anything to do with that decision, today we're doing X.
As a side note, I don't think "clean tackle" really explains anything. Of course the ref thinks it's a clean tackle, that's why he didn't blow his whistle - the question the player is actually asking is "why haven't you blown for a foul there?". Clean tackle, no foul or any variation on those doesn't answer that question at all and is just a waste of breath in terms of explanation.
Remember as well it isn't just the players you are explaining to, you also have spectators. You don't need to be a senior referee to officiate at levels with paying spectators, a Level 5 can be in the middle for step 6 games, and in pointing at the ball you are perpetuating the myth that winning the ball means it cannot be a foul.