Goolsbee told CNBC that he's been hearing more concerns from businesses in his region about the impact of tariffs.