I think you can find a middle ground between “I assume they’d come and politely discuss it” and “I think constantly whether my every single minor action can offend someone”.