For what it's worth, the "caching" is critical for cross compiles because you can't test for functionality using binaries that don't run on your system. But that's not really caching -- that's preconfiguration. I don't see much point in actually caching things on a native system.