פירוש על עבודה זרה 143:1

The baraita does not mean to say that he is not obligated to make restitution. He has not really taken possession of anything such that he would not have to return it. Rather it means to say that the laws of restitution do not apply to him because he never really takes possession of the item.