KIPT LHC data analysis at KIPT CMS Tier-2 center O.Bunetskij, K.Klimenko, S.Lukyanenko, A.Pristavka, D.Soroka, P.Sorokin NSC Kharkov Institute of Physics & Technology, Ukraine

KIPT The CMS Computing Model Tier 1 KIPT Online System CERN 700k SI95 ~1 PB Disk; Tape Robot FNAL IN2P3 Center INFN Center RAL Center Institute Institute ~0.25TIPS Workstations ~100 MBytes/sec 2.5 Gbps Mbits/sec Physics data cache ~PByte/sec ~2.5 Gbits/sec Tier2 Center ~2.5 Gbps Tier 0 +1 Tier 3 Tier2 Center Tier 2 Experiment..

KIPT Подготовка ВК ННЦ ХФТИ к принятию данных эксперимента CMS u Подготовка сетевой инфраструктуры и оптимизация маршрутизации через сетевую инфраструктуру GEANT канал связи с CERN 300 Мбит/с ; успешно проведена сертификация линий связи с Т1 и Т2 центрами организована эффективная передача данных CMS в ноябре 2010 г T2_UA_KIPT ассоциирован с физ. группой CMS EWK u Подготовка хранилища данных (SE) ВК ННЦ ХФТИ обновление ПО glite-SE-dpm_mysql, glite-dpm_disk, и др. обновление драйверов, ядер создание разделов /store/user, /store/group, … u Подготовка вычислительного элемента (CE) ВК ННЦ ХФТИ конфигурирование грид-пользователей с учётом ролей priorityuser настройка планировщика задач maui для оперативной обработки тестовых задач (CMS JobRobot ~700, OPS SAM Test, dteam)+ резервирование процессорных ядер на вычислительных узлах u Обновление узла PhEDEX (v.3.3.1) ВК ННЦ ХФТИ PhEDEX - Physics Experiment Data Export Storage Consistency Check, Data transfer validation

KIPT T2_UA_KIPT end of 2010 T2_UA_KIPT 2011nominal CMS Т2 center at LHC startup (CMS Computing ТDR) minimal CMS Т2 center for 2011 nominal CMS Т2 center, 2011 (CMS Week, Dec 2010) SRM Storage (TB) WN (kHEPspec06) Connectivity (Gbit/s) … Associations with physics groups 1 (EWK) n/a2 NSC KIPT RC

KIPT Initial Requirements to Tier-2 Storage 60 ТВ 30 ТВ 2010/11 30 ТВ 20 ТВ

KIPT NSC KIPT RC structure 3 mysql_disk servers (40TBx3) 19 WNs were added

KIPT WLCG Jobs at T2_UA_KIPT Site Monitoring (WLCG/SAM/SFT, CMS/SAM, CMS/JobRobot); Data Analysis; MC Generation;

KIPT Site readiness CE Monitoring SE Monitoring

KIPT CMS Dashboard

KIPT T2_UA_KIPT batch queues (both lcg-CE and cream-CE) templates for UGRID (to be supported by our VOMS server)

KIPT T2_UA_KIPTAnalysis Jobs Daily Statistics T2_UA_KIPT Analysis Jobs Daily Statistics Grid proxy expiration is the most common reason of WLCG job failures wrong permissions of the directories, created on SE by lcgadmin/prod jobs is the common reason of PhEDEx transfers failures *.root', flags=0x0, permissions=0666) => error 'No such file or directory' (rfio_errno=0, serrno=2) dpns-getacl /dpm/kipt.kharkov.ua/home/cms/store/mc/SAM/ # file: /dpm/kipt.kharkov.ua/home/cms/store/mc/SAM/ # owner: /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=asciaba/CN=430796/CN=Andrea Sciaba # group: cms/Role=lcgadmin user::rwx group::rwx #effective:rwx other::r-x default:user::rwx default:group::rwx default:other::r-x ~]# dpns-ls -l /dpm/kipt.kharkov.ua/home/cms/store/mc/SAM drwxrwxr-x May QCD_pt_0_15 drwxrwxr-x Mar RelValProdTTbar ~]# dpns-ls -l /dpm/kipt.kharkov.ua/home/cms/store/mc/SAM/RelValProdTTbar/ drwxrwxr-x Jan GEN-SIM-DIGI-RECO

KIPT

KIPT Kharkov-KIPT-LCG2 RC Utilisation (EGI Accounting Portal), ~77000 kSI2k,

KIPT dpns-ls –l /dpm/kipt.kharkov.ua/home/cms/store/mc/ 01 Dec :08: TB /dpm/kipt.kharkov.ua/home/cms/store/mc/Fall10.96 TB /dpm/kipt.kharkov.ua/home/cms/store/mc/JobRobot.01 TB /dpm/kipt.kharkov.ua/home/cms/store/mc/SAM 6.38 TB /dpm/kipt.kharkov.ua/home/cms/store/mc/Spring TB /dpm/kipt.kharkov.ua/home/cms/store/mc/Summer TB /dpm/kipt.kharkov.ua/home/cms/store/mc/Summer10 CMS Fall2010 events transfer PhEDEx – CMS Data Transfers, ) More than 50 ТВ of CMS MC data have been stored at our SE and used by grid jobs in CMS data storing and processing at T2_UA_KIPT

KIPT PhEDEX - Physics Experiment Data Export ) PhEDEX agents To be able to transfer any files in our out, a site must become part of the CMS transfer topology(see - bin/cmssw.cgi/COMP/PHE DEX/Documentation/ - bin/cmssw.cgi/COMP/PHE DEX/Documentation/ Поддержка метакаталога CMS Data integrity Agents: FileDownload, FileExport, FileStager, FileRemove, BlockDownloadVerify DBInstances (Prod, Debug, Dev)

KIPT PhEDEX Monitoring

KIPT (портал PhEDEx – CMS Data Transfers, ) CMS Data Transfers to KIPT in November – December 2010 г.

KIPT

KIPT

KIPT CMS data consistency check at KIPT ( PheDEX utility)

KIPT T2_UA_KIPT Group Usage

KIPT

KIPT Results of the CMS data analysis produced at NSC KIPT Comparison between the results of experimental data analysis and MC data. Drell-Yan processes had been identified for invariant mass of muon pair from 20 to 200 GeV. These processes had been generated by Powheg generator (NLO) in MC data case. By S.T. Lukyanenko

KIPT Plans Top BDII PS GW WNs !!! Participation in the CMS data analysis

KIPT ~]# dpm-qryconf ;date POOL CMSpool DEFSIZE M GC_START_THRESH 0 GC_STOP_THRESH 0 DEF_LIFETIME 7.0d DEFPINTIME 2.0h MAX_LIFETIME 1.0m MAXPINTIME 12.0h FSS_POLICY maxfreespace GC_POLICY lru RS_POLICY fifo GIDS 102 S_TYPE - MIG_POLICY none RET_POLICY R CAPACITY T FREE 98.71T ( 70.6%) ds20.kipt.kharkov.ua /storage CAPACITY 3.58T FREE 73.36G ( 2.0%) ds24.kipt.kharkov.ua /storage CAPACITY 3.58T FREE 73.66G ( 2.0%) ds25.kipt.kharkov.ua /storage CAPACITY 3.58T FREE 73.50G ( 2.0%) ds26.kipt.kharkov.ua /storage CAPACITY 9.09T FREE G ( 2.0%) ds30.kipt.kharkov.ua /storage CAPACITY 3.58T FREE G ( 6.2%) ds31.kipt.kharkov.ua /storage CAPACITY 40.02T FREE 23.57T ( 58.9%) ds32.kipt.kharkov.ua /storage CAPACITY 38.20T FREE 37.13T ( 97.2%) ds33.kipt.kharkov.ua /storage CAPACITY 38.20T FREE 37.38T ( 97.9%) POOL Permanent DEFSIZE M GC_START_THRESH 0 GC_STOP_THRESH 0 DEF_LIFETIME 7.0d DEFPINTIME 2.0h MAX_LIFETIME 1.0m MAXPINTIME 12.0h FSS_POLICY maxfreespace GC_POLICY lru RS_POLICY fifo GIDS 0 S_TYPE - MIG_POLICY none RET_POLICY R CAPACITY 38.19T FREE 19.18T ( 50.2%) cms-se0.kipt.kharkov.ua /storage CAPACITY G FREE 3.43G ( 2.0%) ds21.kipt.kharkov.ua /storage CAPACITY 9.09T FREE 3.59T ( 39.5%) ds22.kipt.kharkov.ua /storage CAPACITY 3.58T FREE 73.38G ( 2.0%) ds23.kipt.kharkov.ua /storage CAPACITY 18.19T FREE 14.66T ( 80.6%) ds27.kipt.kharkov.ua /storage CAPACITY 3.58T FREE G ( 9.7%) ds28.kipt.kharkov.ua /storage CAPACITY 3.58T FREE G ( 14.0%) Fri Sep 16 07:31:17 EEST 2011 ~]# dpm-qryconf ;date POOL CMSpool DEFSIZE M GC_START_THRESH 0 GC_STOP_THRESH 0 DEF_LIFETIME 7.0d DEFPINTIME 2.0h MAX_LIFETIME 1.0m MAXPINTIME 12.0h FSS_POLICY maxfreespace GC_POLICY lru RS_POLICY fifo GIDS 102 S_TYPE - MIG_POLICY none RET_POLICY R CAPACITY T FREE 98.71T ( 70.6%) ds20.kipt.kharkov.ua /storage CAPACITY 3.58T FREE 73.36G ( 2.0%) ds24.kipt.kharkov.ua /storage CAPACITY 3.58T FREE 73.66G ( 2.0%) ds25.kipt.kharkov.ua /storage CAPACITY 3.58T FREE 73.50G ( 2.0%) ds26.kipt.kharkov.ua /storage CAPACITY 9.09T FREE G ( 2.0%) ds30.kipt.kharkov.ua /storage CAPACITY 3.58T FREE G ( 6.2%) ds31.kipt.kharkov.ua /storage CAPACITY 40.02T FREE 23.57T ( 58.9%) ds32.kipt.kharkov.ua /storage CAPACITY 38.20T FREE 37.13T ( 97.2%) ds33.kipt.kharkov.ua /storage CAPACITY 38.20T FREE 37.38T ( 97.9%) POOL Permanent DEFSIZE M GC_START_THRESH 0 GC_STOP_THRESH 0 DEF_LIFETIME 7.0d DEFPINTIME 2.0h MAX_LIFETIME 1.0m MAXPINTIME 12.0h FSS_POLICY maxfreespace GC_POLICY lru RS_POLICY fifo GIDS 0 S_TYPE - MIG_POLICY none RET_POLICY R CAPACITY 38.19T FREE 19.18T ( 50.2%) cms-se0.kipt.kharkov.ua /storage CAPACITY G FREE 3.43G ( 2.0%) ds21.kipt.kharkov.ua /storage CAPACITY 9.09T FREE 3.59T ( 39.5%) ds22.kipt.kharkov.ua /storage CAPACITY 3.58T FREE 73.38G ( 2.0%) ds23.kipt.kharkov.ua /storage CAPACITY 18.19T FREE 14.66T ( 80.6%) ds27.kipt.kharkov.ua /storage CAPACITY 3.58T FREE G ( 9.7%) ds28.kipt.kharkov.ua /storage CAPACITY 3.58T FREE G ( 14.0%) Fri Sep 16 07:31:17 EEST 2011