Related for Nazir 47:15

For what reason do they set aside another Kohen to serve in his stead lest he become disqualified? He serves in his stead and the High Priest returns to his status in the High Priesthood, and the one that served in his stead, all the mitzvot of the High Priesthood are incumbent on him, the words of Rabbi Meir. Rabbi Yosei says, even though they said that "all the mitzvot of the High Priesthood are incumbent on him," [once he has acted as a substitute High Priest] he is not fit neither to be the High Priest nor to perform the functions of an ordinary Kohen. Said Rabbi Yosei, it so happened with Yosef ben Eilim from Tzippori that he served on behalf of the High Priest for one hour and [after that] he was not fit either as a High Priest nor as an ordinary Kohen. When he went out, he said to the King, "The bull and the goat that were sacrificed today, who were they from (i.e., whose property were they)? From me or from the High Priest?" The King knew what he was talking about, [and the King said] to him, "What is this, ben Eilim? It is not enough for you that you performed the service in the place of the High Priest one hour before He Who spoke and the world came into being? Rather, what you are seeking is to take the High Priesthood with you." At that very hour, ben Eilim knew that he had been removed from the High Priesthood.