I think the challenge with swimming is that there is thermodynamics of swimming through water to also contend with. So your body is also having to keep warm whilst losing heat to better heat conducting fluid (water vs air). But I still agree, if Phelps was running or even walking with the same effort he could eat similarly.