May be a basic question.

We have noticed that once an add-on is added to a membership plan, it becomes a permanent part of the plan without a ‘remove’ option. Is there a way to remove an add-on? If not, what are the possible workarounds besides changing to a different membership plan and then switching back?