Skip to content

Commit

Permalink
Update NEWS and REAME for 1.3.0.4
Browse files Browse the repository at this point in the history
  • Loading branch information
cornellwright committed Jul 11, 2016
1 parent e5df4d8 commit 54a6cfd
Show file tree
Hide file tree
Showing 2 changed files with 37 additions and 20 deletions.
5 changes: 5 additions & 0 deletions NEWS
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,11 @@ HIO NEWS

Last updated 2016-06-18

Release hio.1.3.0.4

Multiple test enhancements, better messages on certain failures, job specific
DataWarp information logged.

Release hio.1.3.0.3

Some small test improvements, a fix for partial read and write handling and
Expand Down
52 changes: 32 additions & 20 deletions README
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@
HIO Readme
==========

Last updated 2016-04-06
Last updated 2016-07-10

See file NEWS for a description of changes to hio. Note that this README
refers to various LANL clusters that have been used for testing HIO. Using
Expand Down Expand Up @@ -106,24 +106,23 @@ the comments in the file for instructions and a more detailed description.
Step by step procedure for building and running HIO tests on LANL system Trinity
--------------------------------------------------------------------------------
This procedure is accurate as of 2016-03-02 with HIO.1.2.0.4.
This procedure is accurate as of 2016-07-10 with HIO.1.3.0.4.
1) Get the distribution tarball libhio-1.2.0.1.tar.gz from oine of the following:
a) tr-login1:~cornell/hio/libhio-1.2.0.1.tar.gz
b) yellow /usr/projects/hio/user/rel/libhio-1.2.0.1.tar.gz
c) By request from Cornell Wright - [email protected]
d) Download from Github << need location >>
1) Get the distribution tarball libhio-1.3.0.4.tar.gz from oine of the following:
a) yellow /usr/projects/hio/user/rel/libhio-1.3.0.4.tar.gz
b) By request from Cornell Wright - [email protected]
c) Download from Github: https://github.com/hpc/libhio/releases
2) Untar
3) cd <dir>/libhio-1.2 ( <dir> is where you untarred HIO )
3) cd <dir>/libhio-1.3 ( <dir> is where you untarred HIO )
4) ./hiobuild -cf -s PrgEnv-cray,PrgEnv-gnu -l craype-haswell
At the end of the build you will see:
nid00070 ====[HIOBUILD_RESULT_START]===()===========================================
nid00070 buildhio : Checking /cray_home/cornell/libhio/libhio-1.2/hiobuild.out for build problems
nid00070 buildhio : Checking /cray_home/cornell/libhio/libhio-1.3/hiobuild.out for build problems
41:configure: WARNING: using cross tools not prefixed with host triplet
268:Warning:
nid00070 buildhio : Checking for build target files
Expand All @@ -136,7 +135,7 @@ This procedure is accurate as of 2016-03-02 with HIO.1.2.0.4.
6) ./run_combo -t ./run02 ./run03 ./run12 ./run20 -s z y x -n 1024 512 256 128 64 32 16 -p 32 -b
This will create 84 job scripts in the libhio-1.2/test/run directory and submit the jobs.
This will create 84 job scripts in the libhio-1.3/test/run directory and submit the jobs.
Msub messages are in the cooresponding .jobid files in the same directory. Job output is
directed to corresponding .out files. The number and mix of jobs is controlled by the
parameters. Issue run_combo -h for more information.
Expand All @@ -147,7 +146,7 @@ This procedure is accurate as of 2016-03-02 with HIO.1.2.0.4.
If all jobs ran OK, grep should show 84 files with a count of 1. Like this:
cornell@tr-login1:~/pgm/hio/tr-gnu/libhio-1.2/test> grep -c "RESULT: SUCCESS" run/*.out
cornell@tr-login1:~/pgm/hio/tr-gnu/libhio-1.3/test> grep -c "RESULT: SUCCESS" run/*.out
run/job.20160108.080917.out:1
run/job.20160108.080927.out:1
run/job.20160108.080936.out:1
Expand All @@ -158,17 +157,24 @@ This procedure is accurate as of 2016-03-02 with HIO.1.2.0.4.
Investigate any missing job output or counts of 0.
8) Resources for better understanding and/or modifying these procedures:
8) Alternatively, cd to the libhio-1.3/test directory, run the script
libhio-1.2/README
libhio-1.2/hiobuild -h
libhio-1.2/test/run_combo -h
libhio-1.2/test/run_setup -h
libhio-1.2/test/run02, run03, run12, run20
libhio-1.2/test/xexec -h
libhio-1.2/design/libhio_api.pdf
./check_test
9) Additional test commands, check the results the same way as above.
This will show how many jobs are queued and currently running and how many
output files are incomplete or have failures.
9) Resources for better understanding and/or modifying these procedures:
libhio-1.3/README
libhio-1.3/hiobuild -h
libhio-1.3/test/run_combo -h
libhio-1.3/test/run_setup -h
libhio-1.3/test/run02, run03, run12, run20
libhio-1.3/test/xexec -h
libhio-1.3/design/libhio_api.pdf
10) Additional test commands, check the results the same way as above.
Very simple small single job Moab/DataWarp test:
Expand All @@ -191,4 +197,10 @@ This procedure is accurate as of 2016-03-02 with HIO.1.2.0.4.
directory. If there are any .sh files without corresponding .out files,
look for errors via checkjob -v on the job IDs in the .jobid file.
DataWarp stage-out can impose a significant load on the scratch file system.
To inhibit stage-out (which will reduce test coverage) set the environment:
export HIO_datawarp_stage_mode=disable.
--- End of README ---

0 comments on commit 54a6cfd

Please sign in to comment.