Filters - remove ones that would return 0 products

Hi guys,

Just wondering if there's any way to remove filters if when applied, it would return 0 products?

I.e I have 2 products, one of size L in black and one size S in white

If you click on 'black' then the size S option is not shown as clicking it would search for size S in white which would return 0 results.

Thanks in advance!

Dave