My Yamaha av/receiver which I use for a pre-amp behaves something like that. If I try to adjust the volume down manually on receiver, it goes up. then I turn it the other way thinking I turned it the wrong way and it goes up some more. On one occasion I was afraid I would blow the speakers before I could react with the remote, which doesn't do that. So I quickly hit the master power switch and shut everything off.
Your situation sounds more like a poltergeist though. I've had strange things happen with TV remotes in the past that change the channel by themselves. Even if I had touched the remote, I couldn't have switched and browse the channel menu that fast. On one occasion it changed from the channel I was watching, to a pay per view porn channel and almost activated it, for which I would have been billed. It happened so fast, even if it were interference from a house nearby no one could have scanned and pushed the select button that fast.