Further I/O operations optimization
timestamp1557240780001
After an initial work on this topic in version 4.0, I/O operations have been further optimized (to save a significant number of filesystem I/O operations made to search and evaluate modulefiles.
When fully read, the content of a modulefile is now cached in memory to avoid new I/O operations in case this modulefile should be read one more time during the same module command evaluation.
Except for path, paths, list, avail and aliases module commands always fully read a modulefile whether its full content is needed or just its header to verify its validity. This way modulefiles are only read once on commands that first check modulefile validity then read again valid files to get their full content.
Last but not least, Modules Tcl extension library is introduced to extend the Tcl language in order to provide more optimized I/O commands to read a file or a directory content than native Tcl commands do. This library is built and enabled in modulecmd.tcl script with --enable-libtclenvmodules
configure argument (it is enabled by default). As this library is written in C, it must be compiled and --with-tcl
or --with-tclinclude
configure arguments may be used to indicate where to
find Tcl development files.
Modules Tcl extension library greatly reduces the number of filesystem I/O operations by removing unneeded ioctl
, fcntl
and lstat
system calls done (by Tcl open command) to read each modulefile. Directory content read is also improved by fetching hidden and regular files in one pass. Moreover .modulerc
and .version
read access is tested only if these files are found in the directory.
This change is available in git repository and will be included into the next feature release v4.3.