Contents
Initial Setup of your ATLAS Account
In order to set up the ATLAS directory structure, exceute the following script:
ini atlas atlas_setup.py --create
This will create the directories atlas and atlas/testarea in your home directory and set the appropiate AFS ACLs. atlas and below will be readable by all ATLAS users.
Finally you need your GRID certificate at the NAF. Go back to your home computer where your GRID certificates are and execute the following command.
gsiscp -rp $HOME/.globus atlas.naf.desy.de:
Congratulations! Now you are ready for working on the NAF.
General path for ATLAS related software
The ATLAS software is installed below
/afs/naf.desy.de/group/atlas/software/
Setting up the ATLAS software environment
AtlasSetup
The ATLAS software at the NAF should be setup via ATLAS: AtlasSetup. This is similar to the depreciated way via ATLAS: AtlasLogin using source ~/cmthome/setup.sh -tag= but much easier to use for kit installations.
The command to setup the ATLAS software environment is called asetup.
asetup 17.0.3,here
will setup release 17.0.3 using the current directory as testarea. Please note, that the setup of a testarea needs to be explicitly requested.
asetup 17.0.3 --multi --testarea=$HOME/atlas/testarea
will setup release 17.0.3 using $HOME/atlas/testarea/17.0.3 as testarea.
A nice feature is that asetup can store the configuration in a file, which can later be retrieved again:
mkdir ~/atlas/testarea/17.0.3 cd ~/atlas/testarea/17.0.3 asetup 17.0.3 --save
Later on, you can retrieve this setup by just typing the following:
cd ~/atlas/testarea/17.0.3 asetup --restore
You will appreciate this if you are working with different testareas and longer setup arguments.
asetup can be configured to always save the configuration into the current directory. Create the file .asetup in your home directory and add the following lines:
[defaults] save = True autorestore = True briefprint = True
autorestore will load the save configuration using plain asetup. briefprint will print a short summary of the release which is set up.
For more details see:
CERN SVN Server
See the wiki section CERN SVN Server for more details how to access the server (easily).
ATLAS Software Kits
The ATLAS Software installation announcements can be accessed via RSS or Twitter!
ATLAS software kits are installed in
/afs/naf.desy.de/group/atlas/software/releases
All installed kits (base kit and production caches) can be listed using
ini atlas atlas_list_software.py
The following table gives an overview on the installed releases and the available caches on the NAF.
Release |
Architecture |
Production cache(s) |
Tier0 cache(s) |
Comments |
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
17.0.4.1, AtlasPhysics-17.0.4.1.1, 17.0.4.2, AtlasPhysics-17.0.4.2.1, 17.0.4.3, 17.0.4.4, 17.0.4.5, 17.0.4.6, 17.0.4.7 and 17.0.4.8 |
|
|
|
i686_slc5_gcc43_opt |
17.0.3.1, AtlasPhysics-17.0.3.1.1, 17.0.3.2, 17.0.3.3 and 17.0.3.4 |
|
|
|
i686_slc5_gcc43_opt |
17.0.2.1, 17.0.2.2, 17.0.2.3, AtlasPhysics-17.0.2.3.1, 17.0.2.4, 17.0.2.5, 17.0.2.6, 17.0.2.7, 17.0.2.8, 17.0.2.9, 17.0.2.10 and AtlasPhysics-17.0.2.10.1 |
|
|
|
i686_slc5_gcc43_opt |
17.0.1.1, AtlasPhysics-17.0.1.1.1, 17.0.1.2 and AtlasPhysics-17.0.1.2.1 |
|
|
|
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
16.6.7.1, 16.6.7.2, 16.6.7.3, 16.6.7.4, 16.6.7.5, 16.6.7.7, 16.6.7.7, 16.6.7.8, 16.6.7.9, AtlasPhysics-16.6.7.9.1, 16.6.7.10, 16.6.7.11, 16.6.7.12, 16.6.7.13, 16.6.7.14 and 16.6.7.15 |
|
|
|
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
16.6.5.1, 16.6.5.2, 16.6.5.3, 16.6.5.4, 16.6.5.5 and 16.6.5.5.1-AtlasPhysics |
|
|
|
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
16.6.3.1, 16.6.3.2, 16.6.3.3, 16.6.3.4, 16.6.3.5, 16.6.3.5.1-TopPhys, 16.6.3.6 and 16.6.3.7 |
|
|
|
i686_slc5_gcc43_opt |
16.6.2.1, 16.6.2.2, 16.6.2.3, 16.6.2.31, 16.6.2.5 and 16.6.2.6, 16.6.2.6.1-TopPhys |
|
|
|
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
16.2.0.1, 16.2.0.2, 16.2.0.3, 16.2.0.4, 16.2.0.5, 16.2.0.6 and 16.2.0.7 |
|
|
|
i686_slc5_gcc43_opt |
16.0.3.1, 16.0.3.2, 16.0.3.3, 16.0.3.3.1, 16.0.3.3.3, 16.0.3.3.4, 16.0.3.4, 16.0.3.5, 16.0.3.6, 16.0.3.7, 16.0.3.8, 16.0.3.8.2-TopPhys, 16.0.3.9 and 16.0.3.10 |
|
|
|
i686_slc5_gcc43_opt |
16.0.2.1, 16.0.2.2, 16.0.2.3, 16.0.2.4, 16.0.2.5 and 16.0.2.6 |
|
|
|
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
15.6.14.1, 15.6.14.2, 15.6.14.3, 15.6.14.4, 15.6.14.5, 15.6.14.6, 15.6.14.7, 15.6.14.8, 15.6.14.9, 15.6.14.10, 15.6.14.11 and 15.6.14.12 |
|
|
|
i686_slc5_gcc43_opt |
15.6.13.1, 15.6.13.2, 15.6.13.3, 15.6.13.3.2, 15.6.13.7, 15.6.13.8, 15.6.13.9, 15.6.13.9.2, 15.6.13.10, 15.6.13.11 and 15.6.13.12 |
|
|
|
i686_slc5_gcc43_opt |
15.6.12.1, 15.6.12.2, 15.6.12.3, 15.6.12.4.1, 15.6.12.4.2, 15.6.12.5, 15.6.12.6, 15.6.12.7, 15.6.12.7.1, 15.6.12.8, 15.6.12.9, 15.6.12.9.1, 15.6.12.10, and 15.6.12.11 |
|
|
|
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
15.6.10.1, 15.6.10.2, 15.6.10.3, 15.6.10.4, 15.6.10.4.2, 15.6.10.5, 15.6.10.6, 15.6.10.7, 15.6.10.8 and 15.6.10.9 |
|
|
|
i686_slc5_gcc43_opt |
15.6.9.1, 15.6.9.4, 15.6.9.6, 15.6.9.7, 15.6.9.8, 15.6.9.9, 15.6.9.10, 15.6.9.11, 15.6.9.12 and 15.6.9.15 |
|
|
|
i686_slc5_gcc43_opt |
15.6.8.1, 15.6.8.2, 15.6.8.2.1, 15.6.8.3, 15.6.8.4, 15.6.8.5 and 15.6.8.6, 15.6.8.7, 15.6.8.10 and 15.6.8.12 |
|
|
|
i686_slc5_gcc43_opt |
15.6.7.1, 15.6.7.2, 15.6.7.3, 15.6.7.4, 15.6.7.5, 15.6.7.6, 15.6.7.7 and 15.6.7.8 |
|
|
|
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc5_gcc43_opt |
15.6.3.1, 15.6.3.2, 15.6.3.3, 15.6.3.4, 15.6.3.5, 15.6.3.5.1, 15.6.3.5.2, 15.6.3.6, 15.6.3.6.1, 15.6.3.7, 15.6.3.8, 15.6.3.9, 15.6.3.9.1,15.6.3.10, 15.6.3.11, 15.6.3.12, 15.6.3.12.1, 15.6.3.13, 15.6.3.14 and 15.6.3.15 |
|
|
|
i686_slc4_gcc34_opt |
15.6.1.2, 15.6.1.3, 15.6.1.4, 15.6.1.5, 15.6.1.6 and 15.6.1.7 |
|
|
|
i686_slc5_gcc43_opt |
|
|
||
i686_slc4_gcc34_opt |
|
15.6.0 is a copy of 15.5.2 |
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc4_gcc34_opt |
|
|
|
|
i686_slc4_gcc34_opt |
15.5.4.1, 15.5.4.2 , 15.5.4.3, 15.5.4.4, 15.5.4.5, 15.5.4.6, 15.5.4.7, 15.5.4.8, 15.5.4.9, 15.5.4.10, 15.5.4.11, 15.5.4.12, 15.5.4.13, 15.5.4.20 and 15.5.4.21 |
|
||
i686_slc4_gcc34_opt |
|
15.5.3.4, 15.5.3.5, 15.5.3.6, 15.5.3.7 , 15.5.3.8 and 15.5.3.9 | |
|
|
i686_slc5_gcc43_opt |
|
|
||
i686_slc4_gcc34_opt |
|
|
|
|
i686_slc5_gcc43_opt |
|
|
||
i686_slc4_gcc34_opt |
|
|
|
|
i686_slc5_gcc43_opt |
|
|
||
i686_slc4_gcc34_opt |
|
|
|
|
i686_slc5_gcc43_opt |
|
|
||
i686_slc4_gcc34_opt |
|
|
|
|
i686_slc4_gcc34_opt |
15.3.1.1, 15.3.1.2, 15.3.1.3, 15.3.1.4, 15.3.1.5, 15.3.1.6, 15.3.1.7, 15.3.1.8, 15.3.1.9, 15.3.1.10, 15.3.1.11, 15.3.1.12, 15.3.1.13, 15.3.1.14, 15.3.1.20 and 15.3.1.21 |
|
|
|
i686_slc4_gcc34_opt |
|
|
||
i686_slc4_gcc34_opt |
|
|
||
i686_slc5_gcc43_opt |
|
|
||
i686_slc4_gcc34_opt |
15.1.0.1, 15.1.0.2, 15.1.0.3, 15.1.0.4, 15.1.0.5, 15.1.0.6, 15.1.0.7 and 15.1.0.8 |
|
|
|
i686_slc4_gcc34_opt |
|
|
|
|
i686_slc4_gcc34_opt |
|
|
||
i686_slc4_gcc34_opt |
|
|
||
i686_slc4_gcc34_opt |
14.5.1.1, 14.5.1.2, 14.5.1.3, 14.5.1.4, 14.5.1.5 and 14.5.1.6 |
|
|
|
i686_slc4_gcc34_opt |
14.5.0.1, 14.5.0.2, 14.5.0.3, 14.5.0.4, 14.5.0.5, 14.5.0.6 and 14.5.0.7 |
|
|
|
i686_slc4_gcc34_opt |
|
|
||
i686_slc4_gcc34_opt |
14.2.25.1, 14.2.25.2, 14.2.25.3, 14.2.25.4, 14.2.25.5, 14.2.25.6, 14.2.25.7, 14.2.25.8, 14.2.25.9, 14.2.25.10 and 14.2.25.11 |
|
|
|
i686_slc4_gcc34_opt |
14.2.24.1 and 14.2.24.2 |
|
||
i686_slc4_gcc34_opt |
14.2.23.1, 14.2.23.2 and 14.2.23.3 |
|
||
i686_slc4_gcc34_opt |
|
|
||
i686_slc4_gcc34_opt |
|
|
||
i686_slc4_gcc34_opt |
|
|
To use one of the installed caches remember to add the AtlasProduction tag when setting up your environment, e. g.
cd ~/atlas/testarea/17.0.3.1 asetup 17.0.3.1,AtlasProduction
Similar for an analysis cache:
cd ~/atlas/testarea/17.0.3.1.1 asetup AtlasPhysics,17.0.3.1.1
get_tag
To check the default revision for a package in specific (or even all releases) you can use the get_tag command (setup PATH by typing ini atlas).
To find the revision of the 'UserAnalysis' package used in release 17.0.3 type
ini atlas get_tag PhysicsAnalysis/AnalysisCommon/UserAnalysis 17.0.3
or to find the revisions for all releases type
ini atlas get_tag PhysicsAnalysis/AnalysisCommon/UserAnalysis
get_tag_afs is also installed (setup PATH by typing ini atlas), which uses the CERN AFS software installation to figure out the used package tag for a given release (base or production cache).
GetCommand.py
In the production system, transforms are executed, which are wrappers around athena for specific processing steps:
- Generate_trf.py: event generation
AtlasG4_trf.py: G4 simulation
- Digi_trf.py: digitisation and pileup simulation
- Reco_trf.py: reconstruction and DPD/TAG production
- DigiMReco_trf.py: digisation and reconstruction in one go
The full configuration including cache version and release number is encoded into a single letter and a number. AMI can be used to access this information. The configuration can also be retrieved on the command line using GetCommand.py after setting up a recent athena release.
GetCommand.py AMI=r3658
will list the digi+reco setup for mc12:
###############################
Original job transform command:
/cvmfs/atlas.cern.ch/repo/sw/software/i686-slc5-gcc43-opt/17.2.7/AtlasProduction/17.2.7.7/InstallArea/share/bin/GetCommand.py AMI='r3658'
###############################
Successfully interpreted command line: method arg=value...
INFO extraParamater=outputRDOFile=tmpRDO.pool.root is removed. This pseudo-argument is stricly internal to ProdSys.
INFO Using default input value: inputHitsFile=root://eosatlas//eos/atlas/atlascerngroupdisk/proj-sit/digitization/RTT/mc10/mc10_7TeV.105200.T1_McAtNlo_Jimmy.simul.HITS.e598_s933_tid168076_00/HITS.168076._008421.pool.root.1
Reduced input file Name: HITS.168076._008421.pool.root.1
INFO Using default output value: outputTAGFile=myTAG.root
INFO Using default output value: tmpRDO=myRDO.tmp.pool.root
INFO Using default output value: outputESDFile=myESD.pool.root
INFO Using default output value: outputAODFile=myAOD.pool.root
###############################
Atlas Setup Report:
AtlasVersion=17.2.7.7
AtlasProject=AtlasProduction
AtlasPatch=AtlasProduction
AtlasPatchVersion=17.2.7.7
CMTCONFIG=i686-slc5-gcc43-opt
TestArea undefined
No readable patch area found
###############################
INFO trf configuration written in inputDictionary.pickle
[{'info': {'amiInputDic': {'inputHitsFile': 'root://eosatlas//eos/atlas/atlascerngroupdisk/proj-sit/digitization/RTT/mc10/mc10_7TeV.105200.T1_McAtNlo_Jimmy.simul.HITS.e598_s933_tid168076_00/HITS.168076._008421.pool.root.1'}, 'amiTransform': 'DigiMReco_trf.py', 'amiPhysDic': {'triggerConfigByRun': '{195847:"MCRECO:DB:TRIGGERDBMC:325,142,266"}', 'postExec_r2e': 'StreamESD.ItemList%2B=["JetCollection#InTimeAntiKt4TruthJets","JetCollection#OutOfTimeAntiKt4TruthJets"]', 'preExec_e2a': 'TriggerFlags.AODEDMSet="AODSLIM",rec.Commissioning.set_Value_and_Lock(True),jobproperties.Beam.energy.set_Value_and_Lock(4000*Units.GeV),muonRecFlags.writeSDOs=True,jobproperties.Beam.numberOfCollisions.set_Value_and_Lock(20.0),jobproperties.Beam.bunchSpacing.set_Value_and_Lock(50)', 'jobNumber': '0', 'conditionsTag': 'OFLCOND-MC12-SDR-06', 'DBRelease': '19.1.1', 'preInclude_h2r': 'Digitization/ForceUseOfPileUpTools.py,SimulationJobOptions/preInclude.PileUpBunchTrains2011Config8_DigitConfig.py,RunDependentSimData/configLumi_mc12_v1.py', 'digiRndmSvc': 'AtDSFMTGenSvc', 'geometryVersion': 'ATLAS-GEO-20-00-01', 'postExec_e2a': 'StreamAOD.ItemList%2B=["JetCollection#InTimeAntiKt4TruthJets","JetCollection#OutOfTimeAntiKt4TruthJets"],topSequence.InTimeAntiKt4TruthJetsFixIt.Enable=False,topSequence.InTimeAntiKt4TruthJetsSwapper.Enable=False,,topSequence.OutOfTimeAntiKt4TruthJetsFixIt.Enable=False,topSequence.OutOfTimeAntiKt4TruthJetsSwapper.Enable=False', 'preExec_h2r': 'from,LArROD.LArRODFlags,import,larRODFlags,larRODFlags.doOFCPileupOptimization.set_Value_and_Lock(True),larRODFlags.NumberOfCollisions.set_Value_and_Lock(20),larRODFlags.UseDelta.set_Value_and_Lock(3),from,Digitization.DigitizationFlags,import,digitizationFlags,digitizationFlags.overrideMetadata%2B=["SimLayout","PhysicsList"]', 'preExec_r2e': 'from,LArROD.LArRODFlags,import,larRODFlags,larRODFlags.doOFCPileupOptimization.set_Value_and_Lock(True),larRODFlags.NumberOfCollisions.set_Value_and_Lock(20),larRODFlags.UseDelta.set_Value_and_Lock(3),rec.Commissioning.set_Value_and_Lock(True),jobproperties.Beam.energy.set_Value_and_Lock(4000*Units.GeV),muonRecFlags.writeSDOs=True,jobproperties.Beam.numberOfCollisions.set_Value_and_Lock(20.0),jobproperties.Beam.bunchSpacing.set_Value_and_Lock(50),from,CaloRec.CaloCellFlags,import,jobproperties,jobproperties.CaloCellFlags.doLArCellEmMisCalib=False', 'numberOfHighPtMinBias': '0.045336', 'autoConfiguration': 'everything', 'DataRunNumber': '-1', 'LowPtMinbiasHitsFile': 'mc12_8TeV.119995.Pythia8_A2MSTW2008LO_minbias_inelastic_low.merge.HITS.e1119_s1469_s1471', 'numberOfLowPtMinBias': '39.954664', 'HighPtMinbiasHitsFile': 'mc12_8TeV.119996.Pythia8_A2MSTW2008LO_minbias_inelastic_high.merge.HITS.e1119_s1469_s1471'}, 'amiOuputDic': {'outputTAGFile': {'dstype': 'TAG'}, 'tmpRDO': {'dstype': 'RDO.tmp'}, 'outputESDFile': {'dstype': 'ESD'}, 'outputAODFile': {'dstype': 'AOD'} } }, 'outDic': {'postExec_e2a': 'StreamAOD.ItemList%2B=["JetCollection#InTimeAntiKt4TruthJets","JetCollection#OutOfTimeAntiKt4TruthJets"],topSequence.InTimeAntiKt4TruthJetsFixIt.Enable=False,topSequence.InTimeAntiKt4TruthJetsSwapper.Enable=False,,topSequence.OutOfTimeAntiKt4TruthJetsFixIt.Enable=False,topSequence.OutOfTimeAntiKt4TruthJetsSwapper.Enable=False', 'outputESDFile': 'myESD.pool.root', 'digiRndmSvc': 'AtDSFMTGenSvc', 'outputTAGFile': 'myTAG.root', 'triggerConfigByRun': '{195847:"MCRECO:DB:TRIGGERDBMC:325,142,266"}', 'preExec_r2e': 'from,LArROD.LArRODFlags,import,larRODFlags,larRODFlags.doOFCPileupOptimization.set_Value_and_Lock(True),larRODFlags.NumberOfCollisions.set_Value_and_Lock(20),larRODFlags.UseDelta.set_Value_and_Lock(3),rec.Commissioning.set_Value_and_Lock(True),jobproperties.Beam.energy.set_Value_and_Lock(4000*Units.GeV),muonRecFlags.writeSDOs=True,jobproperties.Beam.numberOfCollisions.set_Value_and_Lock(20.0),jobproperties.Beam.bunchSpacing.set_Value_and_Lock(50),from,CaloRec.CaloCellFlags,import,jobproperties,jobproperties.CaloCellFlags.doLArCellEmMisCalib=False', 'preExec_e2a': 'TriggerFlags.AODEDMSet="AODSLIM",rec.Commissioning.set_Value_and_Lock(True),jobproperties.Beam.energy.set_Value_and_Lock(4000*Units.GeV),muonRecFlags.writeSDOs=True,jobproperties.Beam.numberOfCollisions.set_Value_and_Lock(20.0),jobproperties.Beam.bunchSpacing.set_Value_and_Lock(50)', 'inputHitsFile': 'root://eosatlas//eos/atlas/atlascerngroupdisk/proj-sit/digitization/RTT/mc10/mc10_7TeV.105200.T1_McAtNlo_Jimmy.simul.HITS.e598_s933_tid168076_00/HITS.168076._008421.pool.root.1', 'tmpRDO': 'myRDO.tmp.pool.root', 'preExec_h2r': 'from,LArROD.LArRODFlags,import,larRODFlags,larRODFlags.doOFCPileupOptimization.set_Value_and_Lock(True),larRODFlags.NumberOfCollisions.set_Value_and_Lock(20),larRODFlags.UseDelta.set_Value_and_Lock(3),from,Digitization.DigitizationFlags,import,digitizationFlags,digitizationFlags.overrideMetadata%2B=["SimLayout","PhysicsList"]', 'jobNumber': '0', 'conditionsTag': 'OFLCOND-MC12-SDR-06', 'preInclude_h2r': 'Digitization/ForceUseOfPileUpTools.py,SimulationJobOptions/preInclude.PileUpBunchTrains2011Config8_DigitConfig.py,RunDependentSimData/configLumi_mc12_v1.py', 'numberOfHighPtMinBias': '0.045336', 'autoConfiguration': 'everything', 'postExec_r2e': 'StreamESD.ItemList%2B=["JetCollection#InTimeAntiKt4TruthJets","JetCollection#OutOfTimeAntiKt4TruthJets"]', 'DBRelease': '19.1.1', 'DataRunNumber': '-1', 'outputAODFile': 'myAOD.pool.root', 'LowPtMinbiasHitsFile': 'mc12_8TeV.119995.Pythia8_A2MSTW2008LO_minbias_inelastic_low.merge.HITS.e1119_s1469_s1471', 'geometryVersion': 'ATLAS-GEO-20-00-01', 'numberOfLowPtMinBias': '39.954664', 'HighPtMinbiasHitsFile': 'mc12_8TeV.119996.Pythia8_A2MSTW2008LO_minbias_inelastic_high.merge.HITS.e1119_s1469_s1471'}}]
###################################################################
This is command #1:
DigiMReco_trf.py postExec_e2a='StreamAOD.ItemList%2B=["JetCollection#InTimeAntiKt4TruthJets","JetCollection#OutOfTimeAntiKt4TruthJets"],topSequence.InTimeAntiKt4TruthJetsFixIt.Enable=False,topSequence.InTimeAntiKt4TruthJetsSwapper.Enable=False,,topSequence.OutOfTimeAntiKt4TruthJetsFixIt.Enable=False,topSequence.OutOfTimeAntiKt4TruthJetsSwapper.Enable=False' outputESDFile='myESD.pool.root' digiRndmSvc='AtDSFMTGenSvc' outputTAGFile='myTAG.root' triggerConfigByRun='{195847:"MCRECO:DB:TRIGGERDBMC:325,142,266"}' preExec_r2e='from,LArROD.LArRODFlags,import,larRODFlags,larRODFlags.doOFCPileupOptimization.set_Value_and_Lock(True),larRODFlags.NumberOfCollisions.set_Value_and_Lock(20),larRODFlags.UseDelta.set_Value_and_Lock(3),rec.Commissioning.set_Value_and_Lock(True),jobproperties.Beam.energy.set_Value_and_Lock(4000*Units.GeV),muonRecFlags.writeSDOs=True,jobproperties.Beam.numberOfCollisions.set_Value_and_Lock(20.0),jobproperties.Beam.bunchSpacing.set_Value_and_Lock(50),from,CaloRec.CaloCellFlags,import,jobproperties,jobproperties.CaloCellFlags.doLArCellEmMisCalib=False' preExec_e2a='TriggerFlags.AODEDMSet="AODSLIM",rec.Commissioning.set_Value_and_Lock(True),jobproperties.Beam.energy.set_Value_and_Lock(4000*Units.GeV),muonRecFlags.writeSDOs=True,jobproperties.Beam.numberOfCollisions.set_Value_and_Lock(20.0),jobproperties.Beam.bunchSpacing.set_Value_and_Lock(50)' inputHitsFile='root://eosatlas//eos/atlas/atlascerngroupdisk/proj-sit/digitization/RTT/mc10/mc10_7TeV.105200.T1_McAtNlo_Jimmy.simul.HITS.e598_s933_tid168076_00/HITS.168076._008421.pool.root.1' tmpRDO='myRDO.tmp.pool.root' preExec_h2r='from,LArROD.LArRODFlags,import,larRODFlags,larRODFlags.doOFCPileupOptimization.set_Value_and_Lock(True),larRODFlags.NumberOfCollisions.set_Value_and_Lock(20),larRODFlags.UseDelta.set_Value_and_Lock(3),from,Digitization.DigitizationFlags,import,digitizationFlags,digitizationFlags.overrideMetadata%2B=["SimLayout","PhysicsList"]' jobNumber='0' conditionsTag='OFLCOND-MC12-SDR-06' preInclude_h2r='Digitization/ForceUseOfPileUpTools.py,SimulationJobOptions/preInclude.PileUpBunchTrains2011Config8_DigitConfig.py,RunDependentSimData/configLumi_mc12_v1.py' numberOfHighPtMinBias='0.045336' autoConfiguration='everything' postExec_r2e='StreamESD.ItemList%2B=["JetCollection#InTimeAntiKt4TruthJets","JetCollection#OutOfTimeAntiKt4TruthJets"]' DBRelease='19.1.1' DataRunNumber='-1' outputAODFile='myAOD.pool.root' LowPtMinbiasHitsFile='mc12_8TeV.119995.Pythia8_A2MSTW2008LO_minbias_inelastic_low.merge.HITS.e1119_s1469_s1471' geometryVersion='ATLAS-GEO-20-00-01' numberOfLowPtMinBias='39.954664' HighPtMinbiasHitsFile='mc12_8TeV.119996.Pythia8_A2MSTW2008LO_minbias_inelastic_high.merge.HITS.e1119_s1469_s1471'
***Note: using DBRelease is not mandatory for tests on afs and copies large files on your run directory, you might consider NOT using it.
If you still want to use it, you can modify your command to use: DBRelease=/afs/cern.ch/atlas/www/GROUPS/DATABASE/pacman4/DBRelease/DBRelease-19.1.1.tar.gz
***Note: input and output file names are just suggestions, you're expected to change them as you need.***
***DigiMReco_trf note: The minbias HITS files used must match the conditions ***
*** for the main HITS file. Here the minbias 'files' refer to the datasets ***
*** used by this tag, not to specific files. ***GetCommand.py is accessing AMI and AMI needs authentication. There are different options, the easiest is a valid voms proxy for ATLAS. If you are using autoproxy, then ini autoproxy will do the trick.
More information:
http://ami.in2p3.fr/AMI/servlet/net.hep.atlas.Database.Bookkeeping.AMI.Servlet.Command?linkId=512
https://twiki.cern.ch/twiki/bin/viewauth/Atlas/JobTransform#Using_AMI_for_transform_configur
dCache Access
The kits are shipped with the libdcap.so library, neccessary for accessing files directly from dCache. If this library is set up at run time depends on the release:
- up to 14.2.10: libdcap.so is set up by default
for 14.2.20 and later: use the tag useDCACHE when setting up your athena environment (default at NAF)
Database Access
DB releases
By default every main release comes with one DB release. The DB release contains conditions, trigger and other databases. It contains everything needed to work with Monte Carlo (production and processing). The DB releases are stored in the DBRelease directory of the release, e. g. /afs/naf.desy.de/group/atlas/software/kits/17.03./DBRelease. The symbolic link from current to a number defines the default DB release. Automatically, the latest DB release is installed as the current one.
For DB release series 6 and higher all standard releases are also installed in /afs/naf.desy.de/group/atlas/software/DBRelease/DBRelease and added to the DBRelease directory of release 14.4.0 or higher.
In order to use a non default DB release, set the variable DBRELEASE_OVERRIDE to the needed DB release version and then setup your athena environment. For example for DB release 16.9.1 and athena 17.0.3 (DB default is 16.7.1):
export DBRELEASE_OVERRIDE=16.9.1 asetup 17.0.3 athena.py ...
The variable ATLAS_DB_AREA can be used to specify a non default DB location. For more details about ATLAS DB releases see https://twiki.cern.ch/twiki/bin/view/Atlas/AtlasDBRelease, condition tags see https://twiki.cern.ch/twiki/bin/view/Atlas/CoolProdTags and geometry tags see https://twiki.cern.ch/twiki/bin/view/Atlas/AtlasGeomDBTags
Conditions Data Access for Data
For real data up-to-date conditions data is ensured by direct access to the ORACLE DB at the next Tier1. This is GridKa for the NAF. In order not to overload the oracle server and to avoid long turn around times the access is cached using a local Squid server and Frontier access at the Tier1 to the ORACLE DB. Some conditions data need access to flat files, which can be read either from the nearest T2 SE or from a local disk.
By default (since 5.3.2010) conditions data for jobs accessing data (in contrast to MC) will use the local Squid server at DESY-HH T2 and read the conditions flat files from either the Hamburg or Zeuthen Lustre instance, depending where your job runs. You can override this setup by sourcing a specific site and storage type setup file after setting up your athena setup, e.g.
asetup 17.0.3 source /afs/naf.desy.de/group/atlas/software/conditions/local/setup.sh athena.py myJobOptions.py
There are four different setups:
- setup_hh.t2.sh: read flat conditions file from DESY-HH T2 SE
- setup_zn.t2.sh: read flat conditions file from DESY-ZN T2 SE
- setup_hh.lustre.sh: read flat conditions file from Hamburg Lustre instance
- setup_zn.lustre.sh: read flat conditions file from Zeuthen Lustre instance
The cached conditions DB access shouldn't have any effect on MC production, reconstruction and analysis. Please report any problems to naf-atlas-support@desy.de .
Analysis Cache
Since release 15.6.3 special analysis caches (TopPhys, JetMetAnalysis, ...) packages are released as (sub-)caches with an extra number, such as 15.6.3.5.2 in contrast to the normal AtlasProduction cache 15.6.3.5. They are listed in the table above and can be used in the same manner as normal production caches.
ATLAS Contributed Software
We also install the software contributed by ATLAS and installed on the Grid:
- CMT
- gcc43
- cctools (cirp, ...)
The install directory is
/afs/naf.desy.de/group/atlas/software/contrib
The following line will setup all tools except CMT:
source /afs/naf.desy.de/group/atlas/software/contrib/setup.sh
CMT
Recent CMT versions are installed in
/afs/naf.desy.de/group/atlas/software/contrib/CMT/
Of course there is always a release connected version of CMT installed in the corresponding path, e.g.
/afs/naf.desy.de/group/atlas/software/kits/17.0.3/CMT/v1r21
gcc43
Follow the instruction for a gcc43 standalone setup:
export GCC_DIR=/afs/naf.desy.de/group/atlas/software/contrib/gcc-alt-432/x86_64-slc5-gcc43-opt export PATH=$GCC_DIR/bin:$PATH export LD_LIBRARY_PATH=$GCC_DIR/lib:$GCC_DIR/lib64:$LD_LIBRARY_PATH
cctools
Follow the instruction for a cctools standalone setup:
export CCTOOLS_PATH=/afs/naf.desy.de/group/atlas/software/contrib source /afs/naf.desy.de/group/atlas/software/contrib/setup-cctools.sh
Further links: CERN TWiki:ChirpForUserOutput documentation
Pacman
there is a current version of Pacman installed under
/afs/naf.desy.de/group/atlas/software/pacman-latest/
Virtual Point One
Some words on how to use Virtual Point One (VP1) along with release 14.2.21
- set yourself up to use release 14.2.21 following the instruction give on the other pages
get the latest VP1 patch (e.g. 2008-09-08) from the VP1 webpage
source the environment ./vp1-install-patch vp1patch_2008-09-16_14.2.21_i686-slc4-gcc34-opt.tar.bz2 (change the version number if needed)
- this has to be done every timetype vp1 -live and wait some time ... be patient, it take some time to load the libraries/databases
maybe you also have to set a specific geometry: vp1 -live -detdescr=ATLAS-Comm-09-00-00if your machine has a bad hostname you might get the wrong database server assigned
a quick trick is to do export HOSTNAME=whatever.cern.ch (if around cern, substitute domain depending on your location).now you can e.g. load the point1setup.vp1 configuration file from the Configuration menu
- make the display cruise through events by pushing down the button with the green arrow in the lower left corner (a 60s should do since that's the refresh rate of the webserver)
for help considet the vp1 -help option or the VP1 hypernews forum