Yes, it's possible due to something like a tongue thrust. If the retainer was holding the teeth in place, without it the tongue could move them.
In general a week isn't enough time, but you get to 4 weeks or so and you might see movement.
You should probably just get a new retainer made next week so you don't have to stress over this.