Simple job with data manipulation

From MediaWiki

Revision as of 18:55, 27 May 2012 by Ngrkic (Talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

This is advanced job submitting example with data management. In this case, WN will download source code and executing script from SE and after successful ending of job, result will be uploaded on SE.


(You can download src.tgz directly in your working folder with "wget")

Content of uploaded file:


#include <stdio.h>

int main()
 printf ("hello world!!\n");
 return 0;

1. Make a folder "adv"

[ngrkic@ui jobovi]$ mkdir adv

2. Enter adv folder

[ngrkic@ui jobovi]$ cd adv

3. Extract arhive

[ngrkic@ui adv]$ tar xvzf src.tgz

4. Make a adv.jdl file with next content

Executable = "";
Arguments = "";
StdOutput = "std.out";
StdError = "std.err";
InputSandbox = {""};
OutputSandbox = {"std.out", "std.err"};
Requirements =  RegExp("*",other.GlueCEUniqueID);

5. Make a file with following content

#Downloading source code from SE
lcg-cp lfn:/grid/aegis/power/src.tgz 'src.tgz'

#Extract code 
tar xvzf src.tgz

#Compile C file

gcc hello.c -o hello

#Execute hello program

./hello >> output

#Make tgz arhive of output 
tar cvzf output.tgz output

#Uploads output to SE
lcg-cr -l lfn:/grid/aegis/nikola/hello.SE/output.tgz file:`pwd`/output.tgz
lcg-cr -l lfn:/grid/aegis/nikola/hello.SE/std.err file:`pwd`/std.err

6. Creating VOMS proxy:

[ngrkic@ui hello.SE]$ voms-proxy-init -voms aegis

7. Submiting adv job:

[ngrkic@ui hello.SE]$ glite-wms-job-submit -a adv.jdl

8. Requesting Job status:

[ngrkic@ui hello.SE]$ glite-wms-job-status

======================= glite-wms-job-status Success =====================

Status info for the Job :
Current Status:     Done (Success)
Logged Reason(s):
    - Job terminated successfully
Exit code:          0
Status Reason:      Job terminated successfully
Submitted:          Sat Dec 10 22:54:28 2011 CET

9. Download output file from SE

[ngrkic@ui hello.SE]$ lcg-cp lfn:/grid/aegis/nikola/hello.SE/output.tgz file:/home/ngrkic/jobovi/hello.SE/output.tgz

10. Extract arhive

tar xvzf output.tgz

10. Cat output

hello world!!
Personal tools