What is the downside of cutting meat out of a diet?

Jason W asked: I am a vegetarian and I know many positives of vegetarianism, but in an effort to decrease my own bias, I want to hear some information from those who may have opposing viewpoints from me, or those who have similar beliefs but may know things I do not know. So that [...]