There's bigger things I have to worry about than people finding out about my liking for anime/iM@S on a regular basis. That said, I'm not so much scared of it being found out as much as, if someone does find out "oh boy here we go again" (mostly because offline, I'm the sort of person who doesn't like having to answer repeatedly asked questions, especially if I think them useless - and most of the time, anime-related questions are useless to me). Most of the people who do know about that fondness, though, don't really blink an eyelash. They just see it as an extension of my liking for anime (I never play video games when I have guests over, so they can't judge me based upon gameplay content).
...then again, seeing as I'm female and I live alone, this probably isn't as much of an issue for me as it may be for other people.