People are going to look at you, but keep in mind that they might be thinking "That looks like fun," or "I wish I could do that." Here's an example. This past summer, one of my friends took to jumping off the pier and into Lake Michigan on his days off. It's only a four-foot drop and far enough out that the water is clean, but I have never seen anyone else do it. As you might expect, he received more than a few awkward glares. A few weeks later, a customer at his store said that she saw him and was inspired. The next day, that woman of 50+ years grabbed her husband, went to the pier, and had the best day of her summer.
I'm not saying to show off for the crowds, but even after a few weeks, you will be capable of doing things that most people can't. You might get 20 confused stares or comments, but you also might inspire one person to make a change in his/her life for the better.