The vocation of the hermit is often misunderstood. The hermit does not withdraw from the world because he feels rejected, because he can find nothing better to do than wander in the mountains, or because he is unable to assume his responsibilities. He decides to leave, a decision which may seem extreme, because he realizes that he cannot control his mind and solve the problem of happiness and suffering amidst the endless futile and distracting activities of ordinary life.
http://www.matthieuricard.org/en/index.php/MR/blog/237_lhermite/
(Similar justification for going on a meditation retreat)