Yes, you can, thanks to our newest feature.
Head over to Return Settings -> Exchanges -> Variant Exchanges -> Enable Variant Exchanges with locations. Select a location from the dropdown menu and Rich Returns will only look at the specific Inventory location when customers select to exchange a variant.
That should do it. Feel free to share your feedback with our support!