Surely you mean if we don't have DELETE permission on the referencing table? I don't see why we need to be a member of the table owner role.
I would reverse the question - why does this feature need to allow the more broad DELETE permission instead of just limiting it to the table owner? The latter matches the required permission for the existing cascade feature that this is extending.