I'd be shocked if the battery slides out because there's no place for it to slide. It drops into the hole for it as best I can tell.
Walmart is an interesting choice. I am going to call them and see what they say.
A jeweler should be able to do it but it's going to cost me 90% of the cost of a new watch.