It only detracts from the message if you let it.
Consider the following example:
I wrote a story for the book that was both long-winded and confusing.
You tell me, which was long-winded and confusing - the book or the story?
Or, consider the following nonsense:
That that is is that that isn't is not
morphs to make perfect sense when punctuated:
That that is, is. That that isn't, is not.
I.E., I disagree entirely.