Definitely wouldn't recommend it at any time when the crew have asked you to turn off electronics. In reality, it's probably not going to cause a problem during taxi but I would only use it during taxi and have it off for takeoff. Do you want to take the chance that it DOES cause a problem?
As for listening above 10,000 feet I'd say that's not possible. As far as I know (And someone please correct me if I'm wrong) your mobile phone doesn't work in the air and unless the aircraft was Wi-Fi equipped, you'd need a GPRS data connection to get online which wouldn't work. I've never tried turning mine on (stays in Offline mode and only on when electronics are allowed) but I'm told it doesn't work.
If you want to listen to your aircraft taxi out, I'd suggest you listen on the archives when you get to where you're going!