Well I didn't know much of Japanese when I first came there and I survived :) Anyway, not everybody knows English and it was really difficult sometimes.
I agree. It could be really useful learning some phrases and vocabulary in japanese as a lot of them neither understand nor speak english. You should probably practice reading kanji a little as well. It helps in a lot of situations as reading subway stations or a menu in a restaurant.