Well, think of it this way, since you were thinking "better or worse"
Every dollar you spend on companies that lobby for their negative influence and underpay their workers and feed their executives. Each dollar grows their company; every dollar you don't spend on said companies that you would or may have shrinks their company.
Every dollar you spend on organic/fair trade companies grows their budget and their company and pays their workers and feeds their execs. Same goes for every dollar you don't spend on theirs that you spend elsewhere, the company shrinks.