I lived in the East for a little over two years. Basic phrases will go a long way, and most of the heritage sites have English accommodations as well. Transportation is often frustrating, but if you know the basics of Slovak, you can get through it. Spiš Castle, for example, has an English listening guided tour. It depends on your interests, but it's a viable option.