Display the attachments when you open the record they are attached to and allow you to manage the attachment without opening a separate window.
This will greatly enhance the management of attachments and unity of the record.
Lastpass implementation of attachment management is much more cohesive and natural. Attachments are listed in the record and can be added, deleted, and downloaded from the open record. That being said, don’t do anything like LastPass.