@Jay this sounds a bit like a duplicate question to the one you posed in Parallel Test - How to implement different Thresholds for different scenario ? I believe the answer about scenario tags attached to each metric and specified in thresholds fits here too.
