Consumers and businesses are increasingly worried. What everyone from Wall Street investors to economists to the Federal Reserve will be watching closely is whether those concerns lead to a downturn.