You have stopped working with a specific Supplier Company - it might be an idea to deactivate the entire company.
At least so that you and your colleagues don't by accident select this Supplier anymore.
Simple go to Admin-Suppliers.
Find the Supplier Company in question and edit the header area - make sure to set Status to InActive.
And remember to save.