This requires significant effort, since channel modes are currently only tracked for the purposes of monitoring +o and +v changes.
#hmb does some monitoring with it's `ModeMonitoringService` and the `ChannelStatus` object; perhaps that could be brought into IrcClient instead.