Just my opinion, so take it for what it is worth to you. I would change!!!
With the park less crowded, you will be able to enjoy the party more.
Make some dinner reservations at the Crystal Palace for like 4:30 or something.
You can enter the park as early at 4pm using your party ticket.