Users can delete attachments by clicking on an attachment file in the form (or grid if you're using the portal), and then you'll see a delete button.