The earliest playable recording is a lead cylinder from 1878, part of a talking clock invented by Frank Lambert:
http://www.tinfoil.com/cm-0101.htm
The earliest extant recording of music is an excerpt from Handel's 'Israel in Egypt' recorded on a paraffin cylinder at the Crystal Palace in London, June 29, 1888: