Prob should be compressed as 2k odd separate files and then unzip as needed like...

		m3kw9 on April 17, 2023 \| parent \| context \| favorite \| on: RedPajama: Reproduction of LLaMA with friendly lic... Prob should be compressed as 2k odd separate files and then unzip as needed likely get you to 650gb