Of course, you can click on different fields to remove the icon and then put it back. But with these solutions you can scare away an extra million or two users.
Moreover, there are examples of other extensions , in which the Drag’n’Drop method is implemented as much as possible - both inside the extensions and outside.
I myself could give a ready-made example of a solution, but why? For any specialist, this will take exactly 2 lines of code. And there are many variants.