I don't think we need to do anything smart here - it should behave just like dropping a data type, for example. That is, error out if there are columns using the compression method (without CASCADE), and drop all the columns (with CASCADE).
What about instead of dropping column we leave data uncompressed?