Job collection
From MediaWiki
Line 6: | Line 6: | ||
[http://wiki.ipb.ac.rs/images/7/70/Jdlcollection.tgz jdlcollection.tgz ] | [http://wiki.ipb.ac.rs/images/7/70/Jdlcollection.tgz jdlcollection.tgz ] | ||
- | + | [http://wiki.ipb.ac.rs/images/6/6a/Jdlcollection2.tgz jdlcollection2.tgz ] | |
+ | |||
1.Extract file with: | 1.Extract file with: | ||
Revision as of 18:45, 26 May 2012
Submiting job collection How-to
This is job collection submiting example. Collection of two simple jobs. First will print hostname, and second will print date.
For demonstration use attached file.
jdlcollection.tgz jdlcollection2.tgz
1.Extract file with:
[ngrkic@ui ~]$ tgz xvzf jdlcollection.tgz
2.Enter directory jdlcollection with:
[ngrkic@ui ~]$ cd jdlcollection
3.List directory:
[ngrkic@jdlcollection ~]$ ll -rw-rw-r-- 1 ngrkic ngrkic 115 Oct 1 14:07 job1.jdl -rw-rw-r-- 1 ngrkic ngrkic 115 Oct 1 14:17 job2.jdl
Content of file job1.jdl
[ngrkic@ui jdlcollection]$ cat job1.jdl Executable = "/bin/hostname"; StdOutput = "std.out"; StdError = "std.err"; OutputSandbox = {"std.out","std.err"};
Content of file job2.jdl
[ngrkic@ui jdlcollection]$ cat job2.jdl Executable = "/bin/date"; StdOutput = "std2.out"; StdError = "std2.err"; OutputSandbox = {"std2.out","std2.err"};
Then return one folder up with :
[ngrkic@jdlcollection ~]$ cd ..
4.Creating VOMS proxy:
[ngrkic@ui ~]$ voms-proxy-init -voms aegis
Cannot find file or dir: /home/ngrkic/.glite/vomses Enter GRID pass phrase: Your identity: /C=RS/O=AEGIS/OU=Institute of Physics Belgrade/CN=Nikola Grkic Creating temporary proxy ......................... Done Contacting voms.ipb.ac.rs:15001 [/C=RS/O=AEGIS/OU=Institute of Physics Belgrade/CN=host/voms.ipb.ac.rs] "aegis" Done Creating proxy ..................................................... Done Your proxy is valid until Fri Oct 2 01:11:00 2009
5.Submiting job collection:
[ngrkic@ui ~]$ glite-wms-job-submit -a --collection jdlcollection
Connecting to the service https://wms-aegis.ipb.ac.rs:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is:
https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g
==========================================================================
Copy the job ID.Job is running now, and it should finish in few moments...
6.Requesting Job status:
[ngrkic@ui ~]$ glite-wms-job-status https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g Current Status: Done (Success) Exit code: 0 Submitted: Thu Oct 1 14:50:50 2009 CEST ************************************************************* - Nodes information for: Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/7Vhpq3YM3OJIPGfB_yEQzA Current Status: Done (Success) Logged Reason(s): - - Job terminated successfully Exit code: 0 Status Reason: Job terminated successfully Destination: cluster1.csk.kg.ac.rs:2119/jobmanager-pbs-aegis Submitted: Thu Oct 1 14:50:50 2009 CEST ************************************************************* Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/heZyUPQvY4_kFD3V-vzIbQ Current Status: Done (Success) Logged Reason(s): - - Job terminated successfully Exit code: 0 Status Reason: Job terminated successfully Destination: grid-ce.etf.bg.ac.rs:2119/jobmanager-pbs-aegis Submitted: Thu Oct 1 14:50:50 2009 CEST *************************************************************
7.Requesting Job output:
[ngrkic@ui ~]$ glite-wms-job-output --dir /home/ngrkic/test/ https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g Connecting to the service https://wms-aegis.ipb.ac.rs:7443/glite_wms_wmproxy_server ================================================================================ JOB GET OUTPUT OUTCOME Output sandbox files for the DAG/Collection : https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g have been successfully retrieved and stored in the directory: /home/ngrkic/test ================================================================================
8.Go to test directory and see output with commands:
[ngrkic@ui ~]$ cd [ngrkic@ui ~]$ cd test [ngrkic@ui test]$ ll
-rw-rw-r-- 1 ngrkic ngrkic 359 Oct 1 15:14 ids_nodes.map drwxr-xr-x 2 ngrkic ngrkic 4096 Oct 1 14:41 Node_job1_jdl drwxr-xr-x 2 ngrkic ngrkic 4096 Oct 1 14:41 Node_job2_jdl
For each job there is folder with output and error files.You can see content with cat command.
[ngrkic@ui test]$cd Node_job1_jdl [ngrkic@ui Node_job1_jdl]$ cat std.out rti30.etf.bg.ac.rs