מדרש על חגיגה 35:4

R. Yishmael says: We did not learn that work is forbidden on the intermediate days of a festival. Whence do we derive that it is, indeed, forbidden: From "six days shall you eat matzoth and on the seventh day is a holding back" — Just as the seventh day is "held back," so the six days are "held back."