Reassemble linux software raid device

In event of loss of madadm.conf:

echo DEVICE partitions > /etc/mdadm.conf
mdadm -Es >> /etc/mdadm.conf
mdadm -As --auto=yes

it might be necessary to set the nodmraid kernel boot option

Apple Mail ssh tunneling

http://www.ok-labs.com/blog/entry/ssh-tunneling-smtp-on-mac-os-x/

Library/LaunchDaemon/mailtunnel.plist


create key:

ssh -i tunnel_key -q -T mail.example-com

in authorized_keys2 :

command="nc smtp.to.infn.it 25",no-X11-forwarding,no-agent-forwarding,no-port-forwarding

testing:

SSH_AUTH_SOCK= ssh -i .ssh/tunnel_key mail.example.com

Yet another phisym script

in

/afs/cern.ch/cms/CAF/CMSALCA/ALCA_ECALCALIB/phisym/runphisymmetry.sh

does everything after cmsenv and crab setup.



Usage:
./runphisymmetry.sh mode dataset firstrun lastrun globaltag

example:

./runphisymmetry.sh caf /AlCaPhiSymEcal/Run2010A-StreamALCARECOEcalCalPhiSym-v4/ALCARECO 143179 144108 GR10_P_V5::All

How to count number of events

in

/afs/cern.ch/cms/CAF/CMSALCA/ALCA_ECALCALIB/phisym

./query_nevents.sh first run last run dataset

example

./query_nevents.sh 143000 143178 /AlCaPhiSymEcal/Run2010A-StreamALCARECOEcalCalPhiSym-v4/ALCARECO

actual query:

dbs search --url="http://cmsdbsprod.cern.ch/cms_dbs_prod_global/servlet/DBSServlet" --query "find run,file,sum(file.numevents) wher
e dataset like $dataset and run >= $firstrun and run <=$lastrun" | sed '1,4d' |awk 'BEGIN{n=0}{n=n+$3}END{print n}'

Master script phi sym

Script che prepara una nuova dir , configurazione di crab, configurazione di cmssw e json

in

/afs/cern.ch/cms/CAF/CMSALCA/ALCA_ECALCALIB/phisym

makephisym.py --mode=[caf|glite] --dataset=[datasetname] --runrange=[first-last] --globaltag=[tag]

esempio

makephisym.py --mode=glite --dataset=/AlCaPhiSymEcal/Run2010A-StreamALCARECOEcalCalPhiSym-v4/ALCARECO --runrange="140707-143178" --globaltag="GR10_P_V7::All"

cd AlCaPhiSymEcal_Run2010A-StreamALCARECOEcalCalPhiSym-v4_ALCARECO_140707_143178
crab -create
crab -submit

script per merge di etsum

/afs/cern.ch/cms/CAF/CMSALCA/ALCA_ECALCALIB/phisym/AlCaPhiSymEcal_Commissioning10_StreamALCARECOEcalCalPhiSym_v9_ALCARECO_133537_135802/crab_0_100528_211818/res/subsets/40M/merge.sh

rereco with new intecalib constants

use phisym-submit and cfg files in

/afs/cern.ch/cms/CAF/CMSALCA/ALCA_ECALCALIB/phisym/MinimumBias_Commissioning10-GOODCOLL-v7_repro_EcalIntercalibConstants_v7_offline/CMSSW_3_5_4_patch1

command:

./phisym-submit.py -c rereco_EcalIntercalibConstants_v7_offline_35X.py -r GOODCOLL-v7.flst -e rfio:/castor/cern.ch/cms/store/caf/user/argiro/GOODCOLL_v7_EcalIntercalibConstants_v7_RERECO-v2 -n 30 -q cmscaf1nw

Note: cmssw-job was modified to keep logs in same dir

phisym

1. calibration with Vale's code, second iteration on EE, standard GOODCOOLL

code:
/afs/cern.ch/user/v/vsola/scratch0/CMSSW_3_5_6/src/Calibration/EcalCalibAlgos/scripts

command

./phisym-submit.py -c phisym-data-070410.py.tmpl -r RunList_GOODCOLL-v8_0305.txt -q cmscaf1nw -n 20 -e pccmsto03:/data/vsola/phisym/out/OUT_2NDLOOPEE_GOODCOLLV8

out:

pccmsto03:/data/vsola/phisym/out/OUT_2NDLOOPEE_GOODCOLLV8


2. calibration with Vale's code, second iteration on EE, GOODCOOLL skims
code:
/afs/cern.ch/user/v/vsola/scratch0/CMSSW_3_5_6/src/Calibration/EcalCalibAlgos/scripts

command

./phisym-submit.py -c phisym-data-070410.py.tmpl -r GOODCOLL-v8-ALCAECALPHISYM-SKIM-MK2.flst -q cmscaf1nw -n 20 -e pccmsto03:/data/vsola/phisym/out/OUT_2NDLOOPEE_GOODCOLLV8-MK2

out:

pccmsto03:/data/vsola/phisym/out/OUT_2NDLOOPEE_GOODCOLLV8-MK2


3. phisym crab on ALCARECO v9 (133537-135407)

AlCaPhiSymEcal/Commissioning10/StreamALCARECOEcalCalPhiSym_v9/ALCARECO

code : /afs/cern.ch/user/a/argiro/scratch0/splitcode/CMSSW_3_5_6/

run dir:
/afs/cern.ch/cms/CAF/CMSALCA/ALCA_ECALCALIB/phisym/AlCaPhiSymEcal_Commissioning10_StreamALCARECOEcalCalPhiSym_v9_ALCARECO_133537-135407

Phi Sym skims

Skimmed v8 and v9 files to access them much faster. Skims are produced by dropping all branches but Ecal rechits.

File lists :

GOODCOLL-V8 (has only about 15Mevts, a Mk2 is in progress)

GOODCOLL-V8-MK2

GOODCOLL-V9


Launched second iteration as vsola to check EE problematic SCs:

from
scratch0/CMSSW_3_5_6/src/Calibration/EcalCalibAlgos/scripts

./phisym-submit.py -c phisym-data-070410.py.tmpl -r RunList_GOODCOLL-v8_0305_0.txt -q cmscaf1nw -n 20 -e pccmsto03:/data/vsola/phisym/out/OUT_2NDLOOPEE_GOODCOLLV8

using previous constants from

/afs/cern.ch/user/a/argiro/public/EcalIntercalibConstants_GOODCOLL_25M.xml

Skim goodcool

skim GOODCOLL-V8

/afs/cern.ch/user/a/argiro/scratch0/splitcode/CMSSW_3_5_6/src/Calibration/EcalCalibAlgos/

crab cfg : crab-goodcoll-skim.cfg
cfg: physym-skim.cfg
published name (caf dbs) : GOODCOLL-v8-ALCAECALPHISYM-SKIM

miscalibrate 1x1 on data

in

/afs/cern.ch/user/a/argiro/scratch0/miscal1x1/CMSSW_3_5_6/src/Calibration/EcalCalibAlgos/scripts

submit by

./phisym-submit.py -c phisym-data-miscalib.py.tmpl -r RunListData_goodcol_v8.txt -e pccmsto02:/data/argiro/miscal1x1/jobs -n 100 -q cmscaf1nd

to miscalibrate , and

./phisym-submit.py -c phisym-data-miscalib-2M.py.tmpl -r RunListData_goodcol_v8_for_k.txt -e pccmsto02:/data/argiro/miscal1x1/kfact -n 1 -q cmscaf1nd

to calculate k factors

miscalibration used:

CalibCalorimetry/CaloMiscalibTools/data/smeared-eb0.05-ee0.08.xml

Threshold Studies

committed in

UserCode/Torino/Ecal/phisym

work

in /data/argiro/threshh : full stat
/data/argiro/threshhh : 15000000 max per job

work

phisym on beam Alca (from phisym-simscale) to pccmsto /data/argiro/phisym/beam/AlCa

Put ch status single xtal in CVS

pccmsto03
/data/argiro/developement/phisym/CMSSW_3_3_6/s

phisym

dataset

/MinBias/Summer09-STARTUP3X_V8K_900GeV-v1/GEN-SIM-RECO

gives weird et spectra: it is bugged !

Launch on

/MinBias/Summer09-STARTUP3X_V8P_900GeV-v1/GEN-SIM-RECO

crab_0_100217_163431 : miscalibrated by SM

crab_0_100217_163754 : startup (ideal?) miscalib


18/02

sample :
datasetpath=/MinBias/Summer09-V16D_900GeV-v1/GEN-SIM-RECO
crab_0_100218_100729 : no miscalib
crab_0_100218_101000: miscalib
ABORTED !

19/02 relaunch

datasetpath=/MinBias/Summer09-V16D_900GeV-v1/GEN-SIM-RECO

crab_0_100219_163133 miscalibrated
crab_0_100219_163327 not miscalibrated

22/02

launch with less miscalibration on

/MinBias/Summer09-STARTUP3X_V8P_900GeV-v1/GEN-SIM-RECO

sm scale miscalibrated by 0.03

crab_0_100222_160913

25/02

launch with 0.03 sm scale miscalibration on data:

/MinimumBias/BeamCommissioning09-BSCNOBEAMHALO-Dec19thSkim_336p3_v1/RAW-RECO

crab_0_100225_14522
Problem with conf, revert to previous code


1/03

rerun as above
crab_0_100301_222437

old crab dirs moved to /data/argiro/crab-archive

2/03

miscal 3% on data

crab_0_100301_222437 crashed too... try again
crab_0_100303_114710 crashed too... try again
try again in
crab_0_100303_170238


in meanwhile run
0.015 SM miscale on real data
crab_0_100303_132521

shit, wrong miscal file name, relaunch

crab -cfg crab-smscale-realdata-ms0.015.cfg -create

new dir crab_0_100303_155654

4/3
run on full stat of

/MinBias/Summer09-STARTUP3X_V8P_900GeV-v1/GEN-SIM-RECO

crab_0_100304_161618 -> wrong config used.

run on 1MEvt of

/MinBias/Summer09-STARTUP3X_V8P_900GeV-v1/GEN-SIM-RECO

no Sm miscalibration

crab_0_100309_134225/ seems stuck
also in
crab_0_100309_153657




simulation full stat with no thresholds (same dataset as above)
crab_0_100308_222456

simulation 500kevts with no thresholds
crab_0_100308_225733

Phi sym miscalibration and crab

in
scratch0/phisym-simsmscale/CMSSW_3_3_6/src/Calibration/EcalCalibAlgos/scripts

miscalibandphisym.py.tmpl

phisym-submit template to miscalibrate, requires head of CalibCalorimetry/CaloMiscalibTools/src/CaloMiscalibTools.cc

miscalibandphisym.crab.py

same but for crab

crab.cfg

to run phisymmetry with crab and above pset.

source /afs/cern.ch/cms/LCG/LCG-2/UI/cms_ui_env.csh
cmsenv
source /afs/cern.ch/cms/ccs/wm/scripts/Crab/crab.csh

crab -create
crab -submit


To run normal calibration workfow with crab, modify crab.cfg to use
phisym-step1.crab.py

update 17/02 : bug found !
miscalibandphisym.crab.py did not miscalibrate !

directory

crab_0_100212_104838

has ideal calibration.

directory
crab_0_100217_105851

has 10% miscalib by SM

Phi Sym loop

Under test in

scratch0/w09/calibrate/CMSSW_3_2_5/src/Calibration/EcalCalibAlgos/scripts

Command

./phisym-analysis.sh phisym-loop-test.py.tmpl w09-alcareco.flst pccmsto03 /data/argiro/developement/looptest 3 cmscaf1nh

Work on package integration

on lxbuild151

still have to sort out tags in the queue