I blame to Oline, injures at RB and the lack of Hardy, alot more than White or the secondary.
If the OLine blocked better then the O could move the ball on the ground, run the clock and limit the amount of time the D would have to spend on the field which is how the Panthers want to play. Obviously the injuries to DeAngelo, Stewart and Tolbert have made matters even worse but the Oline wasnt really blocking for them either.
Without Hardy nobody seems to be able to get a pass rush besides Addison. Even when Hardy didnt get sacks last year I noticed that he was still getting pressure on the passer but now QBs have plenty of time to pick apart the secondary.