Villagers have a chance to appear on the map of the hot spring during the day or night. You can check whether there are people in the hot spring on the small map. If you want to change people, you can sleep and refresh.