Looking Japanese

A problem with going to Japan and being East Asian is that everyone assumes you are Japanese. I mean, why not? And this isn't really that much of a problem except that people speak Japanese to you and you seem kind of rude because you can't really say anything back besides, "Do you speak English?" I finally would just say, "English?" which seemed to work pretty well. The other problem with not speaking Japanese is that it rather limits communication. Like that time I wanted to order ramen with meat and ordered ramen without meat because I only recognized the meat kanji character and not the "no" part.