He took his wife and baby and went down to Egypt