Potential tariffs, a surgeon general health warning, and persistent inflation concerns among consumers are weighing on the businesses.