The 'unlinking' function is always available if the field has the Finder option enabled. It allows users to select and unselect records.
You can find the setting to disable it here:
Record Finder Options > Select Hide record finder button
💡Tip
In the linked records field setting, there's another option that you can use to achieve the same result. Turn on Read-only.