Back when major news sites still had comment sections, any article about atheism almost always had at least one person asking "If you don't believe in God, what's stopping you from robbing, raping, and killing all the time?"
Just because you're apparently a potential serial killer only kept in check by your fear of divine punishment, that doesn't mean everyone else also lacks the ability to form an internal moral code, even though believing that might make you feel better about yourself.