Well, private browsing really functions as mechanism to discourage people from routinely deleting their cookies. (Which, according to a mid-2000s report, was an extremely common user activity.) Firefox always had an option to delete history/cookies on exit.