Worries are beginning to mount that the tumult in Washington could start weighing on growth, posing a potential threat to stocks.