A lot of people will schedule cheat days in which they go beyond their normal diet. It's not unhealthy to do this.
Chris and Steve - You said that sugar was the issue. What about taken immediately post-workout? The sugar would raise blood glycogen levels back up which would be a benefit would it not?