Currently the Sheet Specific BCC email will always be copied on sign-ups/removals for that sheet and you can optionally include them on Status emails as well by using the Send to “Sheet BCC” Recipients you mentioned that you were using. However, there isn’t setting to only send sheet specific status emails to recipients.
If this is a feature you need, though, please send a message through the Contact Form and I can provide a quote to build this out for you.