After the surge of hate speech by far-right groups in the late 2000s, several such groups sought to use local public facilities to promulgate hate speech chiefly against Koreans resident in Japan. This led local governments to confront the difficult question of how to strike a balance between freedom of assembly (and expression), on the one hand, and the interests of minority residents, on the other. In this chapter, it is argued that local governments can sometimes refuse hate groups use of their facilities to protect local minority residents and that the guidelines issued by some local governments are constitutional despite some notable defects. Many constitutional law scholars in Japan will certainly oppose this conclusion, but this chapter contends that their position cannot be supported, because it overcategorizes conflicting interests and abstracts highly complex factors. It must be recognized that there are exceptions to free speech protections in relation to certain categories of hate speech. Some cases on the use of public facilities by hate groups constitute an example of such exceptions, because certain uses will clearly harm minority residents and thereby contravene the public purpose of establishment and operation of those facilities.