This replay (#712) demonstrates the bug.
When you seek in a replay and the place where the replay started gets replaced with blocks, the replay shows that you are inside a block for the rest of the replay. No matter if you seek backwards to where the space was free, or let time play. You have to exit and reenter a replay to fix this.