Where you "would not want to exclude speech that offends a single person," I would not want to offend a single person for the sake of any speech or action.

Kindness to every person and to one person matters.