well if your in other peoples yards, or on anyone elses property, then yea thats kinda illegal anyways, but if your just at a school or something, then it does tend to happen alot, because just like skateboarding, they really dont like people around schools and stuff when its not school time, try sticking to public parks and stuff, to avoid people yelling at you. (wow that was the longest sentence EVER)

This might sound really dumb, but you could always try talking to the police or this person(s) that keeps forcing you away.  Just make sure you explain what and why you are doing.  You might be surprised how people will react to kindness..........except for certain new jersey police (but that's another story).