Outlook can’t tell the difference.

Alternatively you could block only certain folders using this method.

You’ll probably have to do a Send/Receive before the items disappear from the list.

Prevent Outlook with Gmail IMAP from Showing Duplicate Tasks in the To-Do Bar

You could also exclude items from All Mail by reversing the condition to exclude instead.

image

image

image

image