You have stopped worked with specific Supplier Company - it might be an idea to deactivate the entire company.
At least so that you and your colleagues don't by accident selects this Supplier anymore.
Simple go to Admin-Suppliers.
Find the Supplier Company in question and edit the header area - make sure to set Status to InActive.
And remember to save.