sctp: don't consider the interface name when removing an address

Checking the interface name can not be done consistently, so
don't do it.

MFC after: 3 days