The waiting time needed for a stock market index to undergo a given percentage change in its value is found to whave an up-down asymmetry, which, surprisingly, is not observed for the individual stocks composing that index. To explain this, we introduce a market model consisting of randomly fluctuating stocks that occasionally synchronize their short term draw-downs. These synchronous events are parameterized by a ``fear factor'', that reflects the occurrence of dramatic external events which affect the financial market.