Why do some people fail to understand that defamation is illegal?

I think American's are so caught up in their "Freedom of Speech" that they fail to consider that their freedom ends when it causes damages to another person. Also a lot of people don't fully grasp the difference between the criminal and civil justice systems. Since saying something about someone else isn't a crime in most states people think that they won't get in trouble for it.