I don't think it's a bug, just something that would be nice if it worked differently. I file a feature request:
While writing that, I see I could write the entire playback control in javascript, which might mean I don't lose my IVR position. I'd still have to deal with stopping/restarting the playback.