Right now, you are only able to remove items from groups if you replace the item with another one (if there is only one item in the group to begin with that is). The only option you have in this case would be to delete the item all together or remove the group link. It would be helpful to have the option to simply hide items so that you don't have to go back and recreate them when they need to be made available again.