Power button topic

I go to charge my one x. Light doesn't come on. Have to hold power down for quite a bit to turn on . Kinda like u do when u soft reset. I was on cm11 nightly ,torched kernel also. Then I wiped system cache etc and installed back up. Then I factory reset the backup and the prob solved.... But now,its doing it again..went to power on one x and led light was off..then I had to hold power down for like 10 secs.what Would could cause this??if I want a fix,think I could just flash an ruu?

chris