The purpose of this study is to identify the effects of social withdrawal and depression on adolescents’s physical education record. This study used middle school students data of KCYFS, and total 2,218 surveys were used for the actual analysis. The collected data were conducted reliability analysis, correlation analysis, regression analysis, and path analysis with SPSS 18.0 Version. Thereby, the following results are gained. First, it is found that adolescents’s physical education record has negative(-) influence on social withdrawal. Secondly, it is found that adolescents’s physical education record has negative( -) influence on depression. Third, it is found that adolescents’s social withdrawal has positive(+) influence on depression. Lastly, the research showed that there is the causal relationship between adolescents’s physical education record and social withdrawal as well as depression. Therefore, it is found that social withdrawal is an important parameter which enhances the relation between physical education record and team depression.