Everything can do a fruit body harm. And by harm I mean deteriorate the actives. From light to handling. Any type of advanced (or any) handling will cause oxidation. Peices break off, the actives in that piece are more subject to light, oxogen, etc, etc, and persist to break down at a more advanced rate than if they were just left alone in the dark not being handled.
So as you can see, minimal contact with a fruit body will ensure a minimal drop in potency if any.