One possible solution is to substitute the label of the edit button with a blank space. This way, the edit button remains technically present, but its visibility is diminished.
I want to hide the edit button but I still want the in-line editing to work.