Difference between “delete” and “remove”

Delete and remove are defined quite similarly, but the main difference between them is that delete means erase (i.e. rendered nonexistent or nonrecoverable), while remove connotes take away and set aside (but kept in existence).

In your example, if the item is existent after the removal, just say remove, but if it ceases to exist, say delete.

As a side note: delete is sometimes used of computer files to mean move to trash/recycle bin (hence it is still recoverable), but that's not a standard meaning outside of that context.