The Sages taught: During the tenure of Shimon HaTzaddik, the lot for God always arose in the High Priest’s right hand; after his death, it occurred only occasionally; but during the forty years prior to the destruction of the Second Temple, the lot for God did not arise in the High Priest’s right hand at all. So too, the strip of crimson wool that was tied to the head of the goat that was sent to Azazel did not turn white, and the westernmost lamp of the candelabrum did not burn continually.
-Yoma 39b:5