If you think the refs we have are bad, you probably don't remember just how bad it got the last time they used replacement refs... including an incident of a Packers fan ref massively influencing a game.
The NFL, when you consider all the other things tied to it like TV rights, betting, stadiums (construction, ticket prices, heck even parking and concessions), plus merchandizing, is probably a trillion dollar industry. Give the refs what they want, pay them and let's get back to having games.