Alternatively you could buy an external battery holder, carefully break open the case to remove the batteries and solder the wires from the external battery holder to the battery connections. Fixup the case with duct tape.
Thinking of it... removing the circuits and transferring them to a custom enclosure... It takes some time but will give you a truly unique device.