Grammar is an important basic knowledge of Japanese teaching. In the teaching of grammar, etc., it is necessary to pay attention to the cultivation of students’ intercultural communication skills. However, in the current Japanese grammar teaching, there are some problems, such as insufficient cross-cultural input. Based on this, this paper first analyzes the problems in the current Japanese teaching, then comparatively analyzes the teaching content, ideas and methods commonly used in the current Japanese teaching, and points out which ideas and methods are suitable for Japanese teaching from the perspective of cross-cultural communication. Based on the exploration, effective methods of Japanese grammar teaching are indicated for cross-cultural communication.