Unless you intend on cutting yourself off from the rest of the village, you should keep the book with you. You can use it to talk with everyone else.