Many years ago I used to umpire so I have some experience in softball and baseball. Here is my take of refs....Almost all of them are trying to do a good job. It is much harder to ref football today than it was back in the day. More rules, More open offenses, etc.
The main problem that I see is game management. Marking the ball correctly. Especially on out of bounds punts. The white hats need to do better. Marking penalties. I can't tell you how many times I have seen 5 yd penalties turn into 4 yard or 6 yard penalties. No one seems to want to take the time to measure for a first down. Play clock management. Some refs wait wait too long some way too short. Game control. When things get chippy stop the game and warn both sides and then follow up on your warnings.