Job collection

From MediaWiki

Revision as of 14:04, 12 October 2009 by Ngrkic (Talk | contribs)
Jump to: navigation, search

Submiting job collection How-to


This is job collection submiting example. It does not requre some high skills and knowing JDL language. For demonstration use attached file.

jdlcollection.zip

1.Extract file with:

 [ngrkic@ui ~]$ unzip jdlcollection.zip

2.Enter directory jdlcollection with:

 [ngrkic@ui ~]$ cd jdlcollection

3.List directory:

[ngrkic@jdlcollection ~]$ ll
-rw-rw-r--  1 ngrkic ngrkic 115 Oct  1 14:07 job1.jdl
-rw-rw-r--  1 ngrkic ngrkic 115 Oct  1 14:17 job2.jdl
[ngrkic@ui jdlcollection]$ cat job1.jdl 
Executable = "/bin/hostname";
StdOutput = "std.out";
StdError = "std.err";
OutputSandbox = {"std.out","std.err"};
[ngrkic@ui jdlcollection]$ cat job2.jdl 
Executable = "/bin/date";
StdOutput = "std2.out";
StdError = "std2.err";
OutputSandbox = {"std2.out","std2.err"};

This is job collection of two jobs.First will print hostname , and second will print date.


then return one folder up with :

[ngrkic@jdlcollection ~]$ cd ..

4.Creating VOMS proxy:

[ngrkic@ui ~]$ voms-proxy-init -voms aegis
Cannot find file or dir: /home/ngrkic/.glite/vomses
Enter GRID pass phrase:
Your identity: /C=RS/O=AEGIS/OU=Institute of Physics Belgrade/CN=Nikola Grkic
Creating temporary proxy ......................... Done
Contacting  voms.ipb.ac.rs:15001 [/C=RS/O=AEGIS/OU=Institute of Physics Belgrade/CN=host/voms.ipb.ac.rs] "aegis" Done
Creating proxy ..................................................... Done
Your proxy is valid until Fri Oct  2 01:11:00 2009


Now we are ready to submit job collection.


5.Submiting job collection:

[ngrkic@ui ~]$ glite-wms-job-submit -a --collection jdlcollection
Connecting to the service https://wms-aegis.ipb.ac.rs:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is: 

https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g

==========================================================================


Copy the job ID.Job is running now, and it should finish in few moments...


6.Requesting Job status:

[ngrkic@ui ~]$ glite-wms-job-status https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g
*************************************************************
BOOKKEEPING INFORMATION: 

Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g
Current Status:     Done (Success)
Exit code:          0
Submitted:          Thu Oct  1 14:50:50 2009 CEST
*************************************************************

- Nodes information for: 
    Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/7Vhpq3YM3OJIPGfB_yEQzA
    Current Status:     Done (Success)
    Logged Reason(s):
       - 
        - Job terminated successfully
    Exit code:          0
    Status Reason:      Job terminated successfully
    Destination:        cluster1.csk.kg.ac.rs:2119/jobmanager-pbs-aegis
    Submitted:          Thu Oct  1 14:50:50 2009 CEST
*************************************************************
    
    Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/heZyUPQvY4_kFD3V-vzIbQ
    Current Status:     Done (Success)
    Logged Reason(s):
        - 
        - Job terminated successfully
    Exit code:          0
    Status Reason:      Job terminated successfully
    Destination:        grid-ce.etf.bg.ac.rs:2119/jobmanager-pbs-aegis
    Submitted:          Thu Oct  1 14:50:50 2009 CEST
*************************************************************


7.Requesting Job output:

[ngrkic@ui ~]$ glite-wms-job-output --dir /home/ngrkic/test/ https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g
Connecting to the service https://wms-aegis.ipb.ac.rs:7443/glite_wms_wmproxy_server


================================================================================

			JOB GET OUTPUT OUTCOME

Output sandbox files for the DAG/Collection :
https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g
have been successfully retrieved and stored in the directory:
/home/ngrkic/test

================================================================================ 
 

8.Go to test directory and see output with commands:

[ngrkic@ui ~]$ cd 
[ngrkic@ui ~]$ cd test
[ngrkic@ui test]$ ll
-rw-rw-r--  1 ngrkic ngrkic  359 Oct  1 15:14 ids_nodes.map
drwxr-xr-x  2 ngrkic ngrkic 4096 Oct  1 14:41 Node_job1_jdl
drwxr-xr-x  2 ngrkic ngrkic 4096 Oct  1 14:41 Node_job2_jdl


For each job there is folder with output and error file.You can see content with cat command.

[ngrkic@ui test]$cd Node_job1_jdl
[ngrkic@ui Node_job1_jdl]$ cat std.out 
rti30.etf.bg.ac.rs
Personal tools