My initial attempt at this failed as the battery went dead over night. So, last night I fully charged the battery and then attempted it again. After about 30 minutes it started turning on and showing the 'Surface' logo. I removed the rubber bands, boot it, and it came up.
It did mention that...