[Q] Severe wake up lag topic

I've had fairly severe wake up lag on my Note 3 since the beginning, 4-6 seconds is fairly common (6 seconds means it flashes the screen and blanks it out again, going back to sleep, but then I can wake it up again and it responds in 1-2 seconds). I've never seen this on my Galaxy SIII with the same set of apps, but as soon as I got the Note 3, I saw the delay. I've swapped out for a new one (different reason) and see the same behavior.

If it is not common, I'd have to attribute it to an app...but honestly this is a base OS function, no app should be holding the phone in deep sleep. Any ideas would be helpful.