Maybe you can do some kind of heuristic readahead to read the data in advance from HDDs before they are needed for computation...