GLite - EGEE Middleware1 GLite -EGEE middleware. Практический курс пользователя Галактионов В.В Дубна, ОИЯИ. - презентация

1 GLite - EGEE Middleware1 GLite -EGEE middleware. Практический курс пользователя Галактионов В.В Дубна, ОИЯИ

2 GLite - EGEE Middleware2 Система безопасности информации Privacy Шифрование Integrity Цифровая подпись Authentication Сертификаты Authorisation

3 GLite - EGEE Middleware3 Сертификат пользователя Получение сертификата Для Церна руководство по адресу: Для ОИЯИ: lxpub01:~ > grid-cert-request

4 GLite - EGEE Middleware4 –A certificate request and private key is being created You will be asked to enter a PEM pass phrase. This pass phrase is akin to your account password, –and is used to protect your key file. –If you forget your pass phrase, you will need to –obtain a new certificate. –Using configuration from /etc/grid-security/globus-user-ssl.conf –Generating a 1024 bit RSA private key – –writing new private key to '/afs/jinr.ru/user/g/gvv/.globus/userkey.pem' –Enter PEM pass phrase: –Verifying password - Enter PEM pass phrase: –----- –You are about to be asked to enter information that will be incorporated –into your certificate request. –What you are about to enter is what is called a Distinguished Name or a DN. –There are quite a few fields but you can leave some blank –For some fields there will be a default value, –If you enter '.', the field will be left blank –Country Name (2 letter code), do not change! [RU]:Level 0 Organization, do not change! [DataGrid]: –Your institution domain name (e.g. jinr.ru) [jinr.ru]:Your full name (e.g. Ivan Petrov) []:

5 GLite - EGEE Middleware5 A private key and a certificate request has been generated with the subject: /C=RU/O=DataGrid/OU=jinr.ru/CN=Galaktionov Victor If the CN=Galaktionov Victor is not appropriate, rerun this script with the -force -cn "Common Name" options. Your private key is stored in /afs/jinr.ru/user/g/gvv/.globus/userkey.pem Your request is stored in /afs/jinr.ru/user/g/gvv/.globus/usercert_request.pem Please the request to the Russian DataGrid CA You may use a command similar to the following: cat /afs/jinr.ru/user/g/gvv/.globus/usercert_request.pem | mail Only use the above if this machine can send AND receive . if not, please mail using some other method. Your certificate will be mailed to you within two working days. If you receive no response, contact Russian DataGrid CA at

6 GLite - EGEE Middleware6 Результат: В HOME-директории создается поддиректория.globus с 3 файлами: usercert.pem usercert_request.pem userkey.pem или usercert.pem userkey.pem userreq.pem !!! Установите код доступа 400 для файла userkey.pem

7 GLite - EGEE Middleware7 Подпись сертификата Процедура подписи сертификата устанавливается в каждой организации, выполняется через соответствующих уполномоченных. Ему пересылается файл usercert_request.pem или userreq.pem Результат: полученный файл (подписанный сертификат) под именеим usercert.pem c правами доступа 644 запишите в директорию.globus

8 GLite - EGEE Middleware8 Регистрация в виртуальной организации 1. Генерация сертификата для браузера генерация сертификата: Инструкция: openssl pkcs12 -export -inkey userkey.pem \ -in usercert.pem \ -out my_cert.p12 -name "My certificate userkey.pem Путь к закрытому ключу (доступ 400) usercert.pem Путь к файлу сертификата my_cert.p12 Путь к создаваемому сертификату брузера в формате PKCS12. "My certificate" Необязательный параметр.

9 GLite - EGEE Middleware9 - Включение сертификата в браузер: использовать механизм импортрования сертификатов. - Вход в WEB-портал для регистрации членства в VO Доступ через браузер с установленным сертификатом - Получить извещения о регистрации в VO

10 GLite - EGEE Middleware10 Полезные ссылки JRA1: Middleware gLight: Lightweight Middleware for Grid Computing Presentations Prototype testbed

11 GLite - EGEE Middleware11 I. Подключение к GLite Предустановка -Установить сертификаты в /.globus - Регистрация в VO EGEE (voms) Начало сеанса с ЦЕРН AFS ssh Подключение к GLite UI source /afs/cern.ch/project/egee/jra1/prototype/ui/glite-env.sh или source /afs/cern.ch/project/egee/jra1/prototype/ui/glite-env.csh

12 GLite - EGEE Middleware12 GLITE_LOCATION=/afs/cern.ch/project/egee/jra1/prototype/ui/opt/glite GLOBUS_LOCATION=/afs/cern.ch/project/egee/jra1/prototype/ui/opt/globus GLOBUS_PATH=/afs/cern.ch/project/egee/jra1/prototype/ui/opt/globus

13 GLite - EGEE Middleware13 II. Создание proxy-сертификата.Grid proxy: grid-proxy-init.Voms proxy: voms-proxy-init Примечание: если уже есть готовый proxy-сертификат, установить в переменной X509_USER_PROXY путь доступа к файлу

14 GLite - EGEE Middleware14 Voms proxy Для работы с VOMS proxy после первого запуска voms-proxy-init образуется файл $HOME/.glite/vomses со строкой "EGEE" "kuiken.nikhef.nl" "15001 "/O=dutchgrid/O=hosts/OU=nikhef.nl/CN=kuiken.nikhef.nl" "EGEE" "22" Можно работать и так, но можно заменить строку на свои данные, например: EGEE Victor Galaktionov 7912 "/C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 EGEE "22"

15 GLite - EGEE Middleware15 Операции с VOMS proxy voms-proxy-init voms-proxy-info voms-proxy-destroy [lxplus011] ~/.glite > voms-proxy-init -help voms-proxy-init: Options -help, -usage Displays usage -version Displays version -debug Enables extra debug output -q Quiet mode, minimal output -verify Verifies certificate to make proxy for -pwstdin Allows passphrase from stdin -limited Creates a limited proxy -hours H Proxy is valid for H hours (default:12) -bits B Number of bits in key {512|1024|2048|4096} -cert Non-standard location of user certificate -key Non-standard location of user key -certdir Non-standard location of trusted cert dir -out Non-standard location of new proxy cert -voms > Specify voms server. :command is optional. -order > Specify ordering of attributes. -target Targets the AC against a specific hostname. -vomslife Try to get a VOMS pseudocert valid for H hours. -include Include the contents of the specified file. -conf Read options from. -confile Non-standard location of voms server addresses. -userconf Non-standard location of user-defined voms server addresses. -globus Globus version. -noregen Doesn't regenerate a new proxy for the connection. -separate Saves the informations returned by the server on file. -ignorewarn Ignore warnings. -failonwarn Treat warnings as errors.

16 GLite - EGEE Middleware16 cat /afs/cern.ch/project/egee/jra1/prototype/ui/opt/glite/etc/vomses "test" "gridit-wn-010.cnaf.infn.it" "50001" "/C=IT/O=INFN/OU=Host/L=CNAF/CN=gridit-wn-010.cnaf.infn.it» "testVO" "22" "EGEE" "kuiken.nikhef.nl" "15001" "/O=dutchgrid/O=hosts/OU=nikhef.nl/CN=kuiken.nikhef.nl» "EGEE" "22"

17 GLite - EGEE Middleware17 1 вариант lxplus011] ~/.glite > voms-proxy-init Invalid configuration filename: /afs/cern.ch/project/egee/jra1/prototype/ui/opt/glite/etc/vomses Your identity: /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 Enter GRID pass phrase for this identity: Creating temporary proxy Done Creating proxy Done Your proxy is valid until Thu Mar 17 02:15:

18 GLite - EGEE Middleware18 lxplus013] ~/INFN > voms-proxy-info subject : /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912/CN=proxy issuer : /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 identity : /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 type : proxy strength : 512 bits path : /tmp/x509up_u19747 timeleft : 11:55:35

voms-proxy-init -confile.glite/vomses" title="GLite - EGEE Middleware19 2.вариант lxplus071] ~ > gliteui [lxplus071] ~ > cat ~/.glite/vomses "EGEE" "kuiken.nikhef.nl" "15001" "/O=dutchgrid/O=hosts/OU=nikhef.nl/CN=kuiken.nikhef.nl" "EGEE" "22" [lxplus071] ~ > voms-proxy-init -confile.glite/vomses" class="link_thumb"> 19 GLite - EGEE Middleware19 2.вариант lxplus071] ~ > gliteui [lxplus071] ~ > cat ~/.glite/vomses "EGEE" "kuiken.nikhef.nl" "15001" "/O=dutchgrid/O=hosts/OU=nikhef.nl/CN=kuiken.nikhef.nl" "EGEE" "22" [lxplus071] ~ > voms-proxy-init -confile.glite/vomses Your identity: /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 Enter GRID pass phrase for this identity: Creating temporary proxy Done Creating proxy Done Your proxy is valid until Fri Mar 18 01:48: [lxplus071] ~ > voms-proxy-info subject : /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912/CN=proxy issuer : /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 identity : /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 type : proxy strength : 512 bits path : /tmp/x509up_u19747 timeleft : 11:59:50 voms-proxy-init -confile.glite/vomses"> voms-proxy-init -confile.glite/vomses Your identity: /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 Enter GRID pass phrase for this identity: Creating temporary proxy....................................................... Done Creating proxy........................................... Done Your proxy is valid until Fri Mar 18 01:48:26 2005 [lxplus071] ~ > voms-proxy-info subject : /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912/CN=proxy issuer : /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 identity : /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 type : proxy strength : 512 bits path : /tmp/x509up_u19747 timeleft : 11:59:50"> voms-proxy-init -confile.glite/vomses" title="GLite - EGEE Middleware19 2.вариант lxplus071] ~ > gliteui [lxplus071] ~ > cat ~/.glite/vomses "EGEE" "kuiken.nikhef.nl" "15001" "/O=dutchgrid/O=hosts/OU=nikhef.nl/CN=kuiken.nikhef.nl" "EGEE" "22" [lxplus071] ~ > voms-proxy-init -confile.glite/vomses">

voms-proxy-init -confile.glite/vomses Your i" title="GLite - EGEE Middleware20 3 вариант [lxplus058] ~ > gliteui [lxplus058] ~ > cat ~/.glite/vomses "EGEE""Victor Galaktionov""7912" "/C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912» "EGEE""22" [lxplus058] ~ > voms-proxy-init -confile.glite/vomses Your i" class="link_thumb"> 20 GLite - EGEE Middleware20 3 вариант [lxplus058] ~ > gliteui [lxplus058] ~ > cat ~/.glite/vomses "EGEE""Victor Galaktionov""7912" "/C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912» "EGEE""22" [lxplus058] ~ > voms-proxy-init -confile.glite/vomses Your identity: /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 Enter GRID pass phrase for this identity: Creating temporary proxy Done Creating proxy Done Your proxy is valid until Fri Mar 18 01:37: voms-proxy-init -confile.glite/vomses Your i"> voms-proxy-init -confile.glite/vomses Your identity: /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 Enter GRID pass phrase for this identity: Creating temporary proxy.................................... Done Creating proxy.................................... Done Your proxy is valid until Fri Mar 18 01:37:00 2005"> voms-proxy-init -confile.glite/vomses Your i" title="GLite - EGEE Middleware20 3 вариант [lxplus058] ~ > gliteui [lxplus058] ~ > cat ~/.glite/vomses "EGEE""Victor Galaktionov""7912" "/C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912» "EGEE""22" [lxplus058] ~ > voms-proxy-init -confile.glite/vomses Your i">

21 GLite - EGEE Middleware21 [lxplus058] ~ > voms-proxy-info subject : /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912/CN=proxy issuer : /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 identity : /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 type : proxy strength : 512 bits path : /tmp/x509up_u19747 timeleft : 11:59:49

22 GLite - EGEE Middleware22 [lxplus011] ~/.glite > voms-proxy-init -confile vomses -voms EGEE Your identity: /C=CH/O=CERN/OU=GRID/CN=Victor Galaktionov 7912 Enter GRID pass phrase for this identity: Creating temporary proxy Done Trying for old (1.1.x) server

23 GLite - EGEE Middleware23 III. Workload Management System, WMS

24 GLite - EGEE Middleware24 Job Management Основные команды: glite-job-list-match glite-job-submit glite-job-status glite-job-cancel glite-job-output glite-job-logging-info

25 GLite - EGEE Middleware25 Пример jdl-файла: hello.jdl Executable = "/bin/echo"; Arguments = "Hello World"; StdOutput = "Message.txt"; StdError = "stderr.log"; OutputSandbox = {"Message.txt","stderr.log "}; Полная спецификация JDL:

26 GLite - EGEE Middleware26 Рекомендуемый формат команды submit: glite-job submit –config-vo Пример VO config файла: egee.cfg VirtualOrganisation = "EGEE"; NSAddresses = {"gundam.cnaf.infn.it:7772"}; LBAddresses = {"gundam.cnaf.infn.it:9000 "};

27 GLite - EGEE Middleware27 Состояние задач

28 GLite - EGEE Middleware28 Передача задач Пример 1 [lxplus013] ~/INFN > glite-job-submit hello.jdl **** Error: UI_NO_VOMS **** Unable to determine a valid user's VO

29 GLite - EGEE Middleware29 [lxplus013] ~/INFN > glite-job-submit --config-vo egee.cfg hello.jdl Selected Virtual Organisation name (from --config-vo option): egee Connecting to host gundam.cnaf.infn.it, port 7772 Logging to host gundam.cnaf.infn.it, port 9002 ******************************************************* JOB SUBMIT OUTCOME The job has been successfully submitted to the Network Server. Use glite-job-status command to check job current status. Your job identifier is: - ********************************************************

30 GLite - EGEE Middleware30 [lxplus013] ~/INFN > glite-job-status ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : Current Status: Ready Status Reason: unavailable Destination: lxb2022.cern.ch:2119/blah-lsf-jra1_low Submitted: Thu Mar 17 13:03: CET *************************************************************

31 GLite - EGEE Middleware31 [lxplus013] ~/INFN > glite-job-status ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : Current Status: Done (Success) Exit code: 0 Status Reason: Job terminated successfully Destination: lxb2022.cern.ch:2119/blah-lsf-jra1_low Submitted: Thu Mar 17 13:03: CET *************************************************************

32 GLite - EGEE Middleware32 [lxplus013] ~/INFN > glite-job-output Retrieving files from host: gundam.cnaf.infn.it ( for ) ******************************************************* JOB GET OUTPUT OUTCOME Output sandbox files for the job: - have been successfully retrieved and stored in the directory: /tmp/vgalakti_mCg6yqUsdua2iKdYujFt-A ********************************************************

33 GLite - EGEE Middleware33 ls /tmp/vgalakti_mCg6yqUsdua2iKdYujFt-A Message.txt stderr.log cat /tmp/vgalakti_mCg6yqUsdua2iKdYujFt-A/Message.txt Hello World

34 GLite - EGEE Middleware34 Пример 2 [lxplus013] ~/INFN > glite-job-submit --config-vo egee.cfg -o jobiD hello.jdl Selected Virtual Organisation name (from --config-vo option): egee Connecting to host gundam.cnaf.infn.it, port 7772 Logging to host gundam.cnaf.infn.it, port 9002 ====== glite-job-submit Success ============================== The job has been successfully submitted to the Network Server. Use glite-job-status command to check job current status. Your job identifier is: - The job identifier has been saved in the following file: /afs/cern.ch/user/v/vgalakti/INFN/jobiD ========================================================

35 GLite - EGEE Middleware35 [lxplus013] ~/INFN > cat jobiD ###Submitted Job Ids### [lxplus013] ~/INFN > glite-job-status -i jobiD ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : Current Status: Ready Status Reason: unavailable Destination: lxb2022.cern.ch:2119/blah-lsf-jra1_low Submitted: Thu Mar 17 13:15: CET *************************************************************

36 GLite - EGEE Middleware36 [lxplus013] ~/INFN > glite-job-status -i jobiD ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : Current Status: Done (Success) Exit code: 0 Status Reason: Job terminated successfully Destination: lxb2022.cern.ch:2119/blah-lsf-jra1_low Submitted: Thu Mar 17 13:15: CET ************************************************************* [lxplus013] ~/INFN > glite-job-output --dir ~/jobs -i jobiD **** Warning: UI_DIR_NOT_FOUND **** Unable to find the directory "/afs/cern.ch/user/v/vgalakti/jobs" OutputSandbox files will be copied in /tmp. Do you wish to continue? [y/n]n :n bye

37 GLite - EGEE Middleware37 lxplus013] ~/INFN > mkdir jobs [lxplus013] ~/INFN > glite-job-output --dir ~/INFN/jobs -i jobiD Retrieving files from host: gundam.cnaf.infn.it ( for ) ************************************************************ JOB GET OUTPUT OUTCOME Output sandbox files for the job: - have been successfully retrieved and stored in the directory: /afs/cern.ch/user/v/vgalakti/INFN/jobs/vgalakti_81LL1URCdQ_lwdZrf6c81Q ************************************************************* [lxplus013] ~/INFN > ls jobs vgalakti_81LL1URCdQ_lwdZrf6c81Q [lxplus013] ~/INFN > ls jobs/vgalakti_81LL1URCdQ_lwdZrf6c81Q/ Message.txt stderr.log cat jobs/vgalakti_81LL1URCdQ_lwdZrf6c81Q/Message.txt Hello World

38 GLite - EGEE Middleware38 Примечание: Вы можете использовать EDG-команды edg-job-{submit, status, cancel, get-output}

39 GLite - EGEE Middleware39 Пример 3 cat perltest.jdl Executable="perltest.pl"; InputSandbox={"perltest.pl"}; Arguments="Grid"; StdOutput="std.out"; StdError="std.err"; OutputSandbox={"std.out", "std.err"}; cat perltest.pl #!/usr/bin/perl -s if($ARGV[0]) {$argument=$ARGV[0];} print "Your argument is $argument","\n";

40 GLite - EGEE Middleware40 glite-job-submit --config-vo egee.cfg perltest.jdl Selected Virtual Organisation name (from --config-vo option): egee Connecting to host gundam.cnaf.infn.it, port 7772 Logging to host gundam.cnaf.infn.it, port 9002 ***************************************************** JOB SUBMIT OUTCOME The job has been successfully submitted to the Network Server. Use glite-job-status command to check job current status. Your job identifier is: - ********************************************* glite-job-status ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : Current Status: Ready Status Reason: unavailable Destination: lxb2077.cern.ch:2119/blah-pbs-short Submitted: Tue Mar 22 15:22: CET *********************************************

41 GLite - EGEE Middleware41 glite-job-status ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : Current Status: Done (Success) Exit code: 0 Status Reason: Job terminated successfully Destination: lxb2077.cern.ch:2119/blah-pbs-short Submitted: Tue Mar 22 15:22: CET *************************************************************

42 GLite - EGEE Middleware42 glite-job-output Retrieving files from host: gundam.cnaf.infn.it ( for ) ****************************************************** JOB GET OUTPUT OUTCOME Output sandbox files for the job: - have been successfully retrieved and stored in the directory: /tmp/vgalakti_ZLGd49oiQeny73sstND0cw ***************************************************** ls /tmp/vgalakti_ZLGd49oiQeny73sstND0cw/ std.err std.out cat /tmp/vgalakti_ZLGd49oiQeny73sstND0cw/std.out Your argument is Grid

43 GLite - EGEE Middleware43 Пример 4 cat ruJava.sh #!/bin/sh echo "Welcome to Java!" java -version if test -n "${JAVA_HOME}"; then echo "Java exists on this WN, start Java process" echo "Run Java class" java hello exit 0 else { echo "No JVM" exit 2 } fi cat tuJava.jdl Executable="ruJava.sh"; InputSandbox={"ruJava.sh", "hello.class"}; StdOutput="std.out"; StdError="std.err"; OutputSandbox={"std.out", "std.err"};

44 GLite - EGEE Middleware44 glite-job-submit --config-vo egee.cfg -o JID tuJava.jdl Selected Virtual Organisation name (from --config-vo option): egee Connecting to host gundam.cnaf.infn.it, port 7772 Logging to host gundam.cnaf.infn.it, port 9002 ===== glite-job-submit Success ============================= The job has been successfully submitted to the Network Server. Use glite-job-status command to check job current status. Your job identifier is: - The job identifier has been saved in the following file: /afs/cern.ch/user/v/vgalakti/lcg/JID ======================================================

45 GLite - EGEE Middleware45 glite-job-status -i JID ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : Current Status: Ready Status Reason: unavailable Destination: lxb2077.cern.ch:2119/blah-pbs-short Submitted: Tue Mar 22 16:57: CET *************************************************************

46 GLite - EGEE Middleware46 glite-job-status -i JID ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : Current Status: Done (Success) Exit code: 0 Status Reason: Job terminated successfully Destination: lxb2077.cern.ch:2119/blah-pbs-short Submitted: Tue Mar 22 16:57: CET ************************************************************* glite-job-output -i JID Retrieving files from host: gundam.cnaf.infn.it ( for ) ************************************************************** JOB GET OUTPUT OUTCOME Output sandbox files for the job: - have been successfully retrieved and stored in the directory: /tmp/vgalakti_7t2cjWmNSVz_ZZgW3bBhWw **************************************************************

47 GLite - EGEE Middleware47 ls /tmp/vgalakti_7t2cjWmNSVz_ZZgW3bBhWw/ std.err std.out cat /tmp/vgalakti_7t2cjWmNSVz_ZZgW3bBhWw/std.out Welcome to Java! Java exists on this WN, start Java process Run Java class Hello, World! cat /tmp/vgalakti_7t2cjWmNSVz_ZZgW3bBhWw/std.err java version "1.4.2_06" Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2_06-b03) Java HotSpot(TM) Client VM (build 1.4.2_06-b03, mixed mode)

48 GLite - EGEE Middleware48 Пример 5 cat Get.jdl Executable = "Get.sh"; StdOutput = "stdout.log"; StdError = "stderr.log"; InputSandbox = {"Get.sh"}; OutputSandbox = {"stdout.log","stderr.log", "testFile"}; Requirements = other.GlueCEInfoLRMSType == "LSF"; cat Get.sh source /afs/cern.ch/project/egee/jra1/prototype/ui/glite-env.sh glite-get /tmp/plot.py testFile cat testFile

49 GLite - EGEE Middleware49 glite-job-submit --config-vo egee.cfg -o jd Get.jdl glite-job-status -i jd ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : Current Status: Done (Success) Exit code: 0 Status Reason: Job terminated successfully Destination: lxb2022.cern.ch:2119/blah-lsf-jra1_low Submitted: Thu Mar 24 16:02: CET ************************************************************* glite-job-output -i jd Retrieving files from host: gundam.cnaf.infn.it ( for ) ************************************************************** JOB GET OUTPUT OUTCOME Output sandbox files for the job: - have been successfully retrieved and stored in the directory: /tmp/vgalakti_gtw7sOFbmGmNcK8US1t2FA ***************************************************************

50 GLite - EGEE Middleware50 ls /tmp/vgalakti_gtw7sOFbmGmNcK8US1t2FA stderr.log stdout.log testFile cat /tmp/vgalakti_gtw7sOFbmGmNcK8US1t2FA/stdout.log [ glite_get] Total 0.00 MB |====================| % [0.0 Mb/s] Transfer Completed: LFN : /tmp/plot.py GUID : a-549c a0544beef SURL : srm://gridftp05.cern.ch:8443/srm/managerV1?SFN=/castor/cern.ch/user/g/gproduct/EGEETEST/SE/tmp/plot.py Data Written [bytes] : 228 Eff.Transfer Rate[Mb/s] : #! /usr/bin/env python2.2 #--- Galaktionov Victor import os os.popen("gnuplot '/afs/cern.ch/user/v/vgalakti/INFN/plot.cfg'") os.popen("gnuplot '/afs/cern.ch/user/v/vgalakti/INFN/percentPlot.cfg'") cat /tmp/vgalakti_gtw7sOFbmGmNcK8US1t2FA/testFile #! /usr/bin/env python2.2 #--- Galaktionov Victor import os os.popen("gnuplot '/afs/cern.ch/user/v/vgalakti/INFN/plot.cfg'") os.popen("gnuplot '/afs/cern.ch/user/v/vgalakti/INFN/percentPlot.cfg'")[lxplus0

51 GLite - EGEE Middleware51 Data Management Ссылки:

52 GLite - EGEE Middleware52 Работа с каталогом: glite-catalog-{chmod, create, ls, mkdir, rm, rmdir, symlink} Работа с файлами: glite-{put, get}

53 GLite - EGEE Middleware53 1 шаг – посмотреть help и корневой каталог: glite-catalog-ls -h Usage: glite-catalog-ls [options] DIR [DIR...] Available options: -h Print this help text and exit. -q Quiet operation. -s URL Use the catalog service at the specified URL. -v Be more verbose. -V Print the version number and exit. -c Display the creation time instead of the modification time -d List directory entries, not their contents -g Also display GUIDs -l Long output format -R Recursive listing -S Sort by file size -t Sort by time -u Do not sort the output glite-catalog-ls -l /

54 GLite - EGEE Middleware54 Запись файла в SE glite-put local_file_name remote_file_name glite-put -help Version 1.1 by (C) EGEE usage: glite_put [-m ] Optional parameters: -m : the permission to use for the new file (default is 0640). -c : configuration name to be used (Override glite-io-client configuration) -s : silent mode -h : print this screen

55 GLite - EGEE Middleware55 glite-put wms-plot.py /tmp/plot.py [glite_put] Total 0.00 MB |====================| % [0.0 Mb/s] Transfer Completed: LFN : /tmp/plot.py GUID : a-549c a0544beef SURL : srm://gridftp05.cern.ch:8443/srm/managerV1?SFN=/castor/cern.ch/user/g/gproduct/EGEETEST/SE/tmp/plot.py Data Written [bytes] : 228 Eff.Transfer Rate[Mb/s] : glite-catalog-ls -l /tmp/plot.py -pdrwlxgs :45:38 /tmp/plot.py

56 GLite - EGEE Middleware56 glite-catalog-mkdir /vgalakti glite-catalog-ls -l /vgalakti glite-put wms-plot.py /vgalakti/plot.py [glite_put] Total 0.00 MB |====================| % [0.0 Mb/s] Transfer Completed: LFN : /vgalakti/plot.py GUID : 00320c94-5bde c0-898a0544beef SURL : srm://gridftp05.cern.ch:8443/srm/managerV1?SFN=/castor/cern.ch/user/g/gproduct/EGEETEST/SE/vgalakti/plot.py Data Written [bytes] : 228 Eff.Transfer Rate[Mb/s] : glite-catalog-ls -l /vgalakti -pdrwlxgs :16:36 /vgalakti/plot.py

57 GLite - EGEE Middleware57 Чтение файла из Storage Element : glite-get remote_file_name new_local_file glite-get -help Version 1.1 by (C) EGEE usage: glite_get Optional parameters: -c : configuration name to be used (Override glite-io-client configuration) -s : silent mode -h : print this screen

58 GLite - EGEE Middleware58 glite-get /vgalakti/plot.py remote.py [glite_get] Total 0.00 MB |====================| % [0.0 Mb/s] Transfer Completed: LFN : /vgalakti/plot.py GUID : 00320c94-5bde c0-898a0544beef SURL : srm://gridftp05.cern.ch:8443/srm/managerV1?SFN=/castor/cern.ch/user/g/gproduct/EGEETEST/SE/vgalakti/plot.py Data Written [bytes] : 228 Eff.Transfer Rate[Mb/s] :

59 GLite - EGEE Middleware59 Таблица соответствия команд работы с файлами в LCG и GLite LCG GLITE lcg-aa glite-catalog-symlink lcg-cp glite-get lcg-cr glite-put lcg-del glite-rm lcg-la glite-catalog-stat

60 GLite - EGEE Middleware60 glite-catalog-stat /vgalakti LFN: /vgalakti Created: :15: Modified: :15: Size: 0 Type: Directory Expires: Never GUID: F27174F2-14FC-23C3-E030-11AC04137FB2 User: egee Group: egee-group User rights: pdrwlxgs Group rights: --r-lx-- Other rights: gs

61 GLite - EGEE Middleware61 glite-catalog-stat /vgalakti/plot.py LFN: /vgalakti/plot.py Created: :16: Modified: :16: Size: 228 Type: File Expires: Never GUID: 00320c94-5bde c0-898a0544beef Created: :16: Modified: :16: Size: 228 Checksum: Status: 0 User: egee Group: egee-group User rights: pdrwlxgs Group rights: Other rights: Replicas: srm://gridftp05.cern.ch:8443/srm/managerV1?SFN=/castor/cern.ch/user/g/gproduct/EGEETEST/SE/vgalakti/plot.py Master replica Created: :16: Modified: :16:31.000

62 GLite - EGEE Middleware62 glite-catalog-stat lfn:///vgalakti/plot.py LFN: /vgalakti/plot.py Created: :16: Modified: :16: Size: 228 Type: File Expires: Never GUID: 00320c94-5bde c0-898a0544beef Created: :16: Modified: :16: Size: 228 Checksum: Status: 0 User: egee Group: egee-group User rights: pdrwlxgs Group rights: Other rights: Replicas: srm://gridftp05.cern.ch:8443/srm/managerV1?SFN=/castor/cern.ch/user/g/gproduct/EGEETEST/SE/vgalakti/plot.py Master replica Created: :16: Modified: :16:31.000

63 GLite - EGEE Middleware63 glite-get lfn:///vgalakti/plot.py mytest1 [glite_get] Total 0.00 MB |====================| % [0.0 Mb/s] Transfer Completed: LFN : /vgalakti/plot.py GUID : 00320c94-5bde c0-898a0544beef SURL : srm://gridftp05.cern.ch:8443/srm/managerV1?SFN=/castor/cern.ch/user/g/gproduct/EGEETEST/SE/vgalakti/plot.py Data Written [bytes] : 228 Eff.Transfer Rate[Mb/s] : 0.00

64 GLite - EGEE Middleware64 glite-get guid:00320c94-5bde c0-898a0544beef mytest3 [glite_get] Total 0.00 MB |====================| % [0.0 Mb/s] Transfer Completed: LFN : GUID : 00320c94-5bde c0-898a0544beef SURL : srm://gridftp05.cern.ch:8443/srm/managerV1?SFN=/castor/cern.ch/user/g/gproduct/EGEETEST/SE/vgalakti/plot.py Data Written [bytes] : 228 Eff.Transfer Rate[Mb/s] :