Attention New Members - you must register from the APK Website Registration, not the forum registration section.
the exact same thing happens to me, and I take tylenol and some bendadryl before I work out and that seems to help a lot for me, I'm not totally sure about you though, I'm with Chris on this and suggest going to a doctor if this doesn't help it.
My first thought would be that a spike is blood pressure that occurs with exercise is a possibility for causing headaches. Definitely go see a doc (as suggested by others a neurologist would be the best person to see.
I actually would recommend seeing a general practitioner first--portal of entry. For 2 reasons. 1. Insurance covers you if you get a referal in general to a neurologist, paying out of pocket is difficult. 2. many neurologists don't accept walk in patients. 3. this very well could be something NOT neurological. Headaches that are reproduced by valsalvas could be any lesion of the dural or intrathecal pressure. Just go to any portal of entry doc 1st, they should be able to examine and send you to the proper specialist.