I got a nearly similar problem.
As I reassembly my Raspiboy.
I'm not sure but for me it helped to disconnect all cables an connect the speaker first, the D-pad second and the battery at last.
After that, the Pad an anything else worked fine.
Maybe it's a Help, maybe I got only lucky
