pytest: delete interfaces from inside the jail.

This change follows the approach used in 80fc25025ffc, to
minimise the impact of the delayed interface migration.

MFC after: 2 weeks

(cherry picked from commit 20ea7f26e41375828a390fba613b86acfe366add)