Why do people judge Mormons/LDS members so harshly??

It's not like we're the only religion with members ever known to make mistakes in our past. At least we move foward and try to better ourselves on a daily basis. If a member makes a mistake, why does everyone make it out like it's our whole religion that does or says certain things. We are humans, we make mistakes, the mistakes of men or women of our congregation shouldn't in any way reflect on our religion as a whole.