Abandonment is extreme but ultimately is the final nuclear weapon of choice.
Only those named as players, or substitutes, should be on the field of play and with permission drs, physios and or stretcher bearers. Given you have no powers beyond that, you can't even sanction the manager as they...