Parametric Job
From MediaWiki
Submiting parametric job how to
This is simple parametric job submiting example.
For demonstration use attached file.
1.Extract file with:
[ngrkic@ui ~]$ unzip parametric.zip
2.Enter directory single with:
[ngrkic@ui ~]$ cd parametric
3.List directory:
[ngrkic@ui parametric]$ ll
-rw-rw-r-- 1 ngrkic ngrkic 22 Oct 2 11:29 message0.sh -rw-rw-r-- 1 ngrkic ngrkic 22 Oct 2 11:29 message2.sh -rw-rw-r-- 1 ngrkic ngrkic 22 Oct 2 11:29 message4.sh -rw-rw-r-- 1 ngrkic ngrkic 383 Oct 2 11:29 parametric.jdl
This is content of file message0.sh
echo message number 0
This is content of file parametric.jdl
[ JobType = "Parametric"; Executable = "/bin/sh"; Arguments = "message_PARAM_.sh"; InputSandbox = "message_PARAM_.sh"; Parameters= 6; ParameterStep =2; ParameterStart = 0; StdOutput = "myoutput_PARAM_.txt"; StdError = "myerror_PARAM_.txt"; OutputSandbox = {"myoutput_PARAM_.txt", "myerror_PARAM_.txt"}; ShallowRetryCount = 1; ]
4.Creating VOMS proxy:
[ngrkic@ui parametric]$ voms-proxy-init -voms aegis
Cannot find file or dir: /home/ngrkic/.glite/vomses Enter GRID pass phrase: Your identity: /C=RS/O=AEGIS/OU=Institute of Physics Belgrade/CN=Nikola Grkic Creating temporary proxy ......................... Done Contacting voms.ipb.ac.rs:15001 [/C=RS/O=AEGIS/OU=Institute of Physics Belgrade/CN=host/voms.ipb.ac.rs] "aegis" Done Creating proxy ..................................................... Done Your proxy is valid until Fri Oct 2 01:11:00 2009
Now we are ready to submit job.
5.Submiting single job:
[ngrkic@ui parametric]$ glite-wms-job-submit -a parametric.jdl
Connecting to the service https://wms-aegis.ipb.ac.rs:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://wms-aegis.ipb.ac.rs:9000/Vh8g7EU-gCH9LRDnhbx5iw ==========================================================================
Copy the job ID.Job is running now, and it should finish in few moments...
6.Requesting Job status:
[ngrkic@ui parametric]$ glite-wms-job-status https://wms-aegis.ipb.ac.rs:9000/Vh8g7EU-gCH9LRDnhbx5iw ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/Vh8g7EU-gCH9LRDnhbx5iw Current Status: Done (Success) Exit code: 0 Submitted: Fri Oct 2 11:40:25 2009 CEST ************************************************************* - Nodes information for: Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/8ZKpCDU01saOfQj_S4JFqg Current Status: Done (Success) Logged Reason(s): - - Job terminated successfully Exit code: 0 Status Reason: Job terminated successfully Destination: grid-ce.etf.bg.ac.rs:2119/jobmanager-pbs-aegis Submitted: Fri Oct 2 11:40:25 2009 CEST ************************************************************* Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/IvbGjKoP1vzF1mCG8jgyZg Current Status: Done (Success) Exit code: 0 Status Reason: Job terminated successfully Destination: grid01.elfak.ni.ac.rs:2119/jobmanager-pbs-aegis Submitted: Fri Oct 2 11:40:25 2009 CEST ************************************************************* Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/msglck3KPVDh3CytDDu_ow Current Status: Done (Success) Logged Reason(s): - - Job terminated successfully Exit code: 0 Status Reason: Job terminated successfully Destination: grid01.rcub.bg.ac.rs:2119/jobmanager-pbs-aegis Submitted: Fri Oct 2 11:40:25 2009 CEST *************************************************************
7.Requesting Job output:
[ngrkic@ui parametric]$ glite-wms-job-output --dir /home/ngrkic/test https://wms-aegis.ipb.ac.rs:9000/Vh8g7EU-gCH9LRDnhbx5iw
================================================================================ JOB GET OUTPUT OUTCOME Output sandbox files for the DAG/Collection : https://wms-aegis.ipb.ac.rs:9000/Vh8g7EU-gCH9LRDnhbx5iw have been successfully retrieved and stored in the directory: /home/ngrkic/test ================================================================================
8.Go to test directory and see output with commands:
[ngrkic@ui parametric]$ cd [ngrkic@ui single]$ cd test [ngrkic@ui test]$ ll total 16 -rw-rw-r-- 1 ngrkic ngrkic 463 Oct 2 12:21 ids_nodes.map drwxr-xr-x 2 ngrkic ngrkic 4096 Oct 2 11:26 Node_0 drwxr-xr-x 2 ngrkic ngrkic 4096 Oct 2 11:26 Node_2 drwxr-xr-x 2 ngrkic ngrkic 4096 Oct 2 11:26 Node_4
For each node there is folder with myerror.txt and myoutput.txt files.
[ngrkic@ui test]$ cd Node_2 [ngrkic@ui Node_2]$ ll -rw-rw-r-- 1 ngrkic ngrkic 0 Oct 2 12:21 myerror2.txt -rw-rw-r-- 1 ngrkic ngrkic 17 Oct 2 12:21 myoutput2.txt [ngrkic@ui Node_2]$cat myoutput2.txt message number 2