Clearly this isn't a popular opinion in this area. It frustrates me, because obviously the timing of calls (or non-calls) also makes a huge difference.
There were a couple of huge non-calls on early passing plays that benefited the Jaguars. If those calls are made, maybe the Pats are never down the way they were. Maybe those calls and the field position take some of the edge off the aggressiveness of the Jaguar defense. Who knows? There was some serious non-calls all day on both teams (imo) and when that happens it tends to favor the more aggressive team. By all accounts the Jaguars would be described as the more aggressive team. The wrestling suplex on white after he scored his touchdown wasn't whistled, the punches thrown, the taunting after Gronk walked off the field. All of that could have (should have?) been called - and by not doing it - the Jaguars gained a large advantage. A Patriots pass rusher stumbled over a fallen blocker, starts to get up to pursue Bortles and the OL just shoved him in the middle of his back sending him back to the turf. No whistle. So I'll acknowledge that there were a number of missed calls - they were missed on both sides of the ball. But if the ref is going to let them play, which happened - and that approach favors the other team, I'm not going to get too worked up about complaints of the referee.
Finally, knowing what we know about the Patriots playoff/post season record - a referee was chosen that somehow the Patriots had a losing record in front of. What are the odds of that??? That referee should never have been assigned to the Patriots game by the league.