I barely ref 'proper' football these days, half a dozen games a season maybe. Proper mix of post match emotions, but you deffo can't have match sharpness the amount you/I ref which is bound to impact enjoyment. Give it a go properly for a few months and see how you feel after?