make frequency mask caching work

I noticed the frequency mask calculation was taking a few per cent of run time and it looks like the caching is broken.

This MR fixes that.