Heh, you don't have to keep it to yourself; just be ready to be challenged on it, if you're going to be vocal about it. Most of the people who consider themselves part of the "New Atheism Movement" are skeptics first, atheists second. Most of the people on this site fall into that category.
You'll find a lot more Secular Humanists than you will Buddhists around here.
Well, most Buddhists are still atheistic, even if they tend to toss in a lot of spiritual nonsense. If you stray in that direction, you still qualify for the requirement of this site. ^.^
The skeptics might just have an issue with you, if you adopt some of the more religious beliefs of some Buddhist groups. Reincarnation and the Buddhist "if it feels true for you, then it's true," thing don't work so well for anyone of a scientific mindset.