Compression Gets You Distance!