No #1WR certainly isn't helping.
Honestly though... and I hate to say it... I think Pat Shurmur is the biggest problem. His playcalling is atrocious. How many more "Saquon up the middle for no gain" plays do we have to see this season? I know it'll be at least another ten on Sunday.
I know it's probably wishful thinking, but dude's gotta go.