Paper-based playback of media can be performed by electronically recording handwritten notes including pen strokes using a digital pen on a position-coded paper. A plurality of bounding areas is identified, e.g. by generating bounding areas around the pen strokes as they are developed. Each bounding box is provided with a time stamp which indexes a media file, which was recorded simultaneously with the handwritten notes. By placing the digital pen close to a handwritten note on the paper, the part of the media that was recorded when the specific note was written can be recalled. More specifically, the bounding box corresponding to the position of the digital pen is identified and the associated time stamp is used to find the media to recall. This paper-based playback of media can be performed in e.g. a stand-alone device or by a combination of a digital pen and a mobile phone.