Oh hell, take a nasty album and give it a shot, then follow up with more traditional cleaning methods.
I read an account of a guy that religiously used a handheld steamer for cleaning a few years ago (I think it was on "The Vinyl Engine" forum) and I was tempted at the time to try it on some yard sale items but never bought the steamer.
I'd think that distilled water is a must, but I don't recall any specifics beyond that. I do recall that the record surface didn't get hot enough to cause warping. I'm sure that could be done if the steamer remains stationary for too long.
Sorry for the lack of help, but it has been done successfully (no one ever embellishes on the internet, right?).