Running Large Conda Jobs from /home

Oct. 16, 2022

There have been system slowdowns on Eagle recently due to users launching large jobs out of the /home filesystem, particularly jobs calling large conda environments. Please avoid launching large jobs from /home and consider moving your conda environments to your /projects directory before launching a multi-node job. The /home filesystem is not designed for the same high level of input/output operations that the Lustre-based /projects filesystem is built for. The slowdown that can result from a large job in /home can dramatically increase the job runtime, costing AU and possibly causing timeout failures, as well as impact other users and their jobs with system slowdowns, timeouts, and module loading errors.