The item is only a kind of anchor for the servitor, so it won’t hurt the dragon.
And as @Bronyraur said, you can move your servitor to other items. Here at the end of this post @_OM describes a technique to do it: