There needs to be more parameters than simply "push ups". In our fitness testing at the COPK classes our push up test is as many as you can do in 1 minute. You are allowed to rest but only in the up push up position. If you put your knees down or go to downward dog, you are done. Chest must barely touch the ground and arms must be fully locked at the top.
Adding to Ryan's comment
When down:
Chest, chin and thighs
must barely touch the floor.
When up:
Arms must be fully extended (elbows locked), and body straight