We determined the relationship between physical self-perception and sport participation in a cohort with good sport skill. 365 participants, including 191 subjects with>4 years training experiences on various types of sport and 174 subjects without sport training experience, completed Social Physique Anxiety (SPA) Scale and Self-Efficacy for Physical Activity Scale. Sport participation outside office hour, indicated by the product of perceived intensity, duration, and frequency, was self-reported by all subjects. Both self-efficacy levels in participating sport activity and SPA levels were negatively correlated with sport participation for the subjects without sport training experience after controlled for gender. However, this relationship vanished when the subjects confined to the subjects with sport training experience. The novel finding of the study is that linear relationship between SPA and sport participation diminished in cohort with good sport skill, suggesting a value of sport skill acquisition for counterbalancing SPA.