Residents in San Jose's Evergreen hills have led an aggressive campaign to drive out a Buddhist monk and prevent his followers from building a temple.