Speech is free, up to the limit of libel. If I started posting flyers with your picture on them on telephone poles around your neighborhood calling you a pedophile, wouldn't you want there to be some recourse? I don't see this as being very different.