The coronavirus disease 2019 (COVID-19) pandemic has exposed older adults to health and social risks. This study examined the perceptions of community-dwelling older adults regarding how COVID-19 restricted their daily lives. Six focus-group interviews were conducted with 24 participants (mean age, 78.2 ± 5.5 years) living in urban and rural areas in Japan. Then, a qualitative inductive content analysis was performed. Six themes were generated: “fear of infection and public, watchful eyes,” “consistency in daily personal life,” “pain from reducing my social life,” “readiness to endure a restricted life,” “awareness of positive changes in myself,” and “concern for a languishing society.” There was no change that would make their lives untenable, and they continued their daily personal lives at a minimum level. However, their social lives were reduced, which over the long term can lead to a lost sense of purpose in life. This was reported as an adverse factor in the development of other diseases and functional decline in previous studies. While there is no doubt that infection prevention is important, supporting older adults in engaging in activities that provide a sense of purpose in life could contribute to their present and future overall health including mental health.