JobSubmiting

From MediaWiki

(Difference between revisions)
Jump to: navigation, search
Line 1: Line 1:
-
'''Job submiting How to'''
+
'''Submiting job collection How to'''
-
This is simple single job submiting example.
+
This is job collection  submiting example.
It does not requre some high skills and knowing JDL language.
It does not requre some high skills and knowing JDL language.
For demonstration use attached file.
For demonstration use attached file.
1.Extract file with:
1.Extract file with:
-
 
+
   [ngrkic@ui ~]$ tar -xzf jdlcollection.tar.gz
-
   [ngrkic@ui ~]$ tar -xzf single.tar.gz
+
2.Enter directory jdlcollection with:
-
 
+
   [ngrkic@ui ~]$ cd jdlcollection
-
2.Enter directory single with:
+
-
 
+
-
   [ngrkic@ui ~]$ cd single
+
-
 
+
3.List directory:
3.List directory:
 +
  [ngrkic@jdlcollection ~]$ ll
 +
  -rw-rw-r--  1 ngrkic ngrkic 115 Oct  1 14:07 job1.jdl
 +
  -rw-rw-r--  1 ngrkic ngrkic 115 Oct  1 14:17 job2.jdl
-
  [ngrkic@ui single]$ ll
+
then return one folder up with :
-
+
 
-
-rw-rw-r--  1 ngrkic ngrkic  23 Sep 30 23:43 fileA
+
[ngrkic@jdlcollection ~]$ cd ..
-
-rw-rw-r--  1 ngrkic ngrkic  23 Sep 30 23:43 fileB
+
-
-rw-rw-r--  1 ngrkic ngrkic 184 Oct  1 13:00 single.jdl
+
-
-rw-rw-r--  1 ngrkic ngrkic  63 Sep 30 23:42 test.sh
+
4.Creating VOMS proxy:
4.Creating VOMS proxy:
-
  [ngrkic@ui single]$ voms-proxy-init -voms aegis
+
  [ngrkic@ui ~]$ voms-proxy-init -voms aegis
  Cannot find file or dir: /home/ngrkic/.glite/vomses
  Cannot find file or dir: /home/ngrkic/.glite/vomses
Line 33: Line 29:
  Contacting  voms.ipb.ac.rs:15001 [/C=RS/O=AEGIS/OU=Institute of Physics Belgrade/CN=host/voms.ipb.ac.rs] "aegis" Done
  Contacting  voms.ipb.ac.rs:15001 [/C=RS/O=AEGIS/OU=Institute of Physics Belgrade/CN=host/voms.ipb.ac.rs] "aegis" Done
  Creating proxy ..................................................... Done
  Creating proxy ..................................................... Done
-
  Your proxy is valid until Fri Oct  2 01:11:00 2009 </code>
+
  Your proxy is valid until Fri Oct  2 01:11:00 2009
-
Now we are ready to submit job.
+
Now we are ready to submit job collection.
-
5.Submiting single job:
+
5.Submiting job collection:
-
  [ngrkic@ui single]$ glite-wms-job-submit -a single.jdl
+
  [ngrkic@ui ~]$ glite-wms-job-submit -a --collection jdlcollection
  Connecting to the service https://wms-aegis.ipb.ac.rs:7443/glite_wms_wmproxy_server
  Connecting to the service https://wms-aegis.ipb.ac.rs:7443/glite_wms_wmproxy_server
 +
   
   
  ====================== glite-wms-job-submit Success ======================
  ====================== glite-wms-job-submit Success ======================
   
   
-
  The job has been successfully submitted to the WMProxy  
+
  The job has been successfully submitted to the WMProxy
-
  Your job identifier is:
+
  Your job identifier is:  
   
   
-
  https://wms-aegis.ipb.ac.rs:9000/aV8X3jGTiR0cRSsfxhr3nA
+
  https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g
   
   
  ==========================================================================
  ==========================================================================
-
 
Copy the job ID.Job is running now, and it should finish in few moments...
Copy the job ID.Job is running now, and it should finish in few moments...
-
 
6.Requesting Job status:
6.Requesting Job status:
-
  [ngrkic@ui single]$ glite-wms-job-status https://wms-aegis.ipb.ac.rs:9000/aV8X3jGTiR0cRSsfxhr3nA
+
  [ngrkic@ui ~]$ glite-wms-job-status https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g
-
+
 
-
+
  *************************************************************
  *************************************************************
-
  BOOKKEEPING INFORMATION:
+
  BOOKKEEPING INFORMATION:  
-
  Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/aV8X3jGTiR0cRSsfxhr3nA
+
 
 +
  Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g
  Current Status:    Done (Success)
  Current Status:    Done (Success)
-
Logged Reason(s):
 
-
    -
 
-
    - Job terminated successfully
 
  Exit code:          0
  Exit code:          0
-
Status Reason:      Job terminated successfully
+
  Submitted:          Thu Oct  1 14:50:50 2009 CEST
-
Destination:        grid01.rcub.bg.ac.rs:2119/jobmanager-pbs-aegis
+
-
  Submitted:          Thu Oct  1 13:38:10 2009 CEST
+
  *************************************************************
  *************************************************************
 +
 +
- Nodes information for:
 +
    Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/7Vhpq3YM3OJIPGfB_yEQzA
 +
    Current Status:    Done (Success)
 +
    Logged Reason(s):
 +
        -
 +
        - Job terminated successfully
 +
    Exit code:          0
 +
    Status Reason:      Job terminated successfully
 +
    Destination:        cluster1.csk.kg.ac.rs:2119/jobmanager-pbs-aegis
 +
    Submitted:          Thu Oct  1 14:50:50 2009 CEST
 +
*************************************************************
 +
   
 +
    Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/heZyUPQvY4_kFD3V-vzIbQ
 +
    Current Status:    Done (Success)
 +
    Logged Reason(s):
 +
        -
 +
        - Job terminated successfully
 +
    Exit code:          0
 +
    Status Reason:      Job terminated successfully
 +
    Destination:        grid-ce.etf.bg.ac.rs:2119/jobmanager-pbs-aegis
 +
    Submitted:          Thu Oct  1 14:50:50 2009 CEST
 +
*************************************************************
 +
 +
7.Requesting Job output:
7.Requesting Job output:
   
   
-
  [ngrkic@ui single]$ glite-wms-job-output --dir /home/ngrkic/test https://wms-aegis.ipb.ac.rs:9000/aV8X3jGTiR0cRSsfxhr3nA
+
  [ngrkic@ui ~]$ glite-wms-job-output --dir /home/ngrkic/test/ https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g
 +
Connecting to the service https://wms-aegis.ipb.ac.rs:7443/glite_wms_wmproxy_server
 +
 +
  ================================================================================
  ================================================================================
   
   
  JOB GET OUTPUT OUTCOME
  JOB GET OUTPUT OUTCOME
   
   
-
  Output sandbox files for the job:
+
  Output sandbox files for the DAG/Collection :
-
  https://wms-aegis.ipb.ac.rs:9000/aV8X3jGTiR0cRSsfxhr3nA
+
  https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g
  have been successfully retrieved and stored in the directory:
  have been successfully retrieved and stored in the directory:
  /home/ngrkic/test
  /home/ngrkic/test
   
   
-
  ================================================================================
+
  ================================================================================  
 +
 
 +
   
   
8.Go to test directory and see output with commands:
8.Go to test directory and see output with commands:
-
  [ngrkic@ui single]$ cd  
+
  [ngrkic@ui ~]$ cd  
  [ngrkic@ui ~]$ cd test
  [ngrkic@ui ~]$ cd test
-
  [ngrkic@ui ~]$ cat std.out
+
  [ngrkic@ui ~]$ ll
 +
 
 +
-rw-rw-r--  1 ngrkic ngrkic  359 Oct  1 15:14 ids_nodes.map
 +
drwxr-xr-x  2 ngrkic ngrkic 4096 Oct  1 14:41 Node_job1_jdl
 +
drwxr-xr-x  2 ngrkic ngrkic 4096 Oct  1 14:41 Node_job2_jdl
 +
-rw-rw-r--  1 ngrkic ngrkic    0 Oct  1 14:15 std.err
 +
-rw-rw-r--  1 ngrkic ngrkic  22 Oct  1 14:15 std.out
 +
 +
For each job there is a folder with output and error file.You can see content with cat command.
 +
 
 +
[ngrkic@ui Node_job1_jdl]$ cat std.out  
 +
rti30.etf.bg.ac.rs
 +
 
 +
[ngrkic@ui Node_job2_jdl]$ cat std2.out
 +
Thu Oct  1 14:51:06 CEST 2009

Revision as of 10:30, 2 October 2009

Submiting job collection How to


This is job collection submiting example. It does not requre some high skills and knowing JDL language. For demonstration use attached file.

1.Extract file with: 

 [ngrkic@ui ~]$ tar -xzf jdlcollection.tar.gz

2.Enter directory jdlcollection with: 

 [ngrkic@ui ~]$ cd jdlcollection

3.List directory: 

 [ngrkic@jdlcollection ~]$ ll
 -rw-rw-r--  1 ngrkic ngrkic 115 Oct  1 14:07 job1.jdl
 -rw-rw-r--  1 ngrkic ngrkic 115 Oct  1 14:17 job2.jdl

then return one folder up with : 

[ngrkic@jdlcollection ~]$ cd ..

4.Creating VOMS proxy: 

[ngrkic@ui ~]$ voms-proxy-init -voms aegis

Cannot find file or dir: /home/ngrkic/.glite/vomses
Enter GRID pass phrase:
Your identity: /C=RS/O=AEGIS/OU=Institute of Physics Belgrade/CN=Nikola Grkic
Creating temporary proxy ......................... Done
Contacting  voms.ipb.ac.rs:15001 [/C=RS/O=AEGIS/OU=Institute of Physics Belgrade/CN=host/voms.ipb.ac.rs] "aegis" Done
Creating proxy ..................................................... Done
Your proxy is valid until Fri Oct  2 01:11:00 2009

Now we are ready to submit job collection.

5.Submiting job collection: 

[ngrkic@ui ~]$ glite-wms-job-submit -a --collection jdlcollection

Connecting to the service https://wms-aegis.ipb.ac.rs:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is: 

https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g

==========================================================================

Copy the job ID.Job is running now, and it should finish in few moments...

6.Requesting Job status: 

[ngrkic@ui ~]$ glite-wms-job-status https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g

*************************************************************
BOOKKEEPING INFORMATION: 

Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g
Current Status:     Done (Success)
Exit code:          0
Submitted:          Thu Oct  1 14:50:50 2009 CEST
*************************************************************

- Nodes information for: 
    Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/7Vhpq3YM3OJIPGfB_yEQzA
    Current Status:     Done (Success)
    Logged Reason(s):
       - 
        - Job terminated successfully
    Exit code:          0
    Status Reason:      Job terminated successfully
    Destination:        cluster1.csk.kg.ac.rs:2119/jobmanager-pbs-aegis
    Submitted:          Thu Oct  1 14:50:50 2009 CEST
*************************************************************
    
    Status info for the Job : https://wms-aegis.ipb.ac.rs:9000/heZyUPQvY4_kFD3V-vzIbQ
    Current Status:     Done (Success)
    Logged Reason(s):
        - 
        - Job terminated successfully
    Exit code:          0
    Status Reason:      Job terminated successfully
    Destination:        grid-ce.etf.bg.ac.rs:2119/jobmanager-pbs-aegis
    Submitted:          Thu Oct  1 14:50:50 2009 CEST
*************************************************************


7.Requesting Job output: 

[ngrkic@ui ~]$ glite-wms-job-output --dir /home/ngrkic/test/ https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g

Connecting to the service https://wms-aegis.ipb.ac.rs:7443/glite_wms_wmproxy_server


================================================================================

			JOB GET OUTPUT OUTCOME

Output sandbox files for the DAG/Collection :
https://wms-aegis.ipb.ac.rs:9000/e00XBJLV2BRYWfDxOfHL6g
have been successfully retrieved and stored in the directory:
/home/ngrkic/test

================================================================================

8.Go to test directory and see output with commands: 

[ngrkic@ui ~]$ cd 
[ngrkic@ui ~]$ cd test
[ngrkic@ui ~]$ ll

-rw-rw-r--  1 ngrkic ngrkic  359 Oct  1 15:14 ids_nodes.map
drwxr-xr-x  2 ngrkic ngrkic 4096 Oct  1 14:41 Node_job1_jdl
drwxr-xr-x  2 ngrkic ngrkic 4096 Oct  1 14:41 Node_job2_jdl
-rw-rw-r--  1 ngrkic ngrkic    0 Oct  1 14:15 std.err
-rw-rw-r--  1 ngrkic ngrkic   22 Oct  1 14:15 std.out

For each job there is a folder with output and error file.You can see content with cat command. 

[ngrkic@ui Node_job1_jdl]$ cat std.out 
rti30.etf.bg.ac.rs

[ngrkic@ui Node_job2_jdl]$ cat std2.out 
Thu Oct  1 14:51:06 CEST 2009
Retrieved from "http://wiki.ipb.ac.rs/index.php/JobSubmiting"
Personal tools