Plugin Support¶

SPHGR is configured by default to work with Rockstar-Galaxies (DM-halo groups incl. gas&stars) and SKID (baryonic groupings). You must download a custom version of RS-G whose link is below.

python¶

You will need a working python installation that includes numpy, cython, scipy, and cPickle. Most all-in-one distros (EPD/anaconda) should come with most of these components. You can also install mpi4py if you want to run the data analysis in parallel.

pyGadgetReader¶

SPHGR reads gadget files via pygadgetreader; this is a custom python backend that allows you to easily read in Gadget files. It currently supports Gadget type 1, TIPSY, and HDF5 binary files. Download pygadgetreader from bitbucket and compile & install via the following commands:

> python setup.py install

See the ecnlosed readme within pygadgetreader for further details or installation tips/suggestions.

ROCKSTAR-GALAXIES¶

Currently, you must download a modified version which allows for SPHGR to do it’s job much quicker. The custom fork can be found via this bitbucket link. We then need to compile both rockstar-galaxies and the parents utility via:

> make
> make parents

HDF5: edit the Makefile and ensure that you specify your HDF5 include and lib paths in the HDF5_FLAGS variable. Then compile in the following manner:

> make with_hdf5
> make parents

SKID¶

In order to use SKID you must download the customized version found here; it has been modified to read Gadget type1-binaries and HDF5 files directly. Modify the Makefile and comment/uncomment -DGADGET and/or -DHDF5 depending on what file types you will be using. The compilation should then be as simple as:

> make

HDF5: ensure that the HDF5INCL and HDF5LIB directories within the Makefile point to your HDF5 installtion before compilation.

configs/config.py¶

This file contains global parameters related to running the code. The first few variables should be fairly self explanatory. But the most important ones are the variables SKID, RS, RS_FP, MPI, and PY. Edit these so that each points directly to the executable of the respective program.

note: If you have both MPI and mpi4py set USE_MPI=1 to allow for parallel analysis.

configs/sim_config.py¶

This file is slightly tricky; it holds the information needed to find your snapshots. The code allows for the customization of how your snaps are named and stored. The first thing you’ll want to edit is the SIMBASEDIR variable which farther down in the file; this tells the code where to start looking. SNAPDIR dictates how your snapshot directory is formatted, and SNAPNAME dictates how your snapshot files are formatted. The easiest way to illustrate how this works is by example. If we have the following configuration:

SIMBASEDIR    = '/Users/bob'
SNAPDIR       = '%s/%s'
SNAPDIR_OPTS  = '(%s,%s)' % (DIR_OPTS.get(0), DIR_OPTS.get(1))
SNAPNAME      = '%s/snap_%s_%03d'
SNAPNAME_OPTS = '(%s,%s,%s)' % (SNAP_OPTS.get(0),SNAP_OPTS.get(1),SNAP_OPTS.get(2))

then when the code is executed the SNAPDIR and SNAPNAME variables will be defined like so:

SNAPDIR  = '/Users/bob/%s'   % (SNAPPRE)
SNAPNAME = '%s/snap_%s_%03d' % (SNAPDIR,SNAPPRE,SNAPNUM)

You will define SNAPPRE and SNAPNUM later when actually executing the code so don’t worry about these for now. What you will notice is that I set SNAPDIR=’%s/%s’ meaning that it will be composed of two strings (string/string). These strings are set via SNAPDIR_OPTS, the .get(N) values are taken from the dict at the top of the configs/sim_config.py file:

SNAP_OPTS = {0:'SNAPDIRS[i]', 1:'SNAPPRE', 2:'SNAPNUMS[j]'}
DIR_OPTS  = {0:'SIMBASEDIR', 1:'SNAPPRE', 2:'DIRPRES[i]'}

These dictionaries use the .get() function to return the string for a given index. I know this is a bit confusing at first, but it was the only way I could implement it so that your snapshot locations and names were completely customizable. It may take some tinkering, but once you set it up you should be good to go.

The DIRPRES variable allows for you to stick snapshots with the same SNAPPRE under different subdirectories. Below is additional explanations for each property within the above dict:

• SNAP_OPTS:

  0. SNAPDIRS[i] = represents snapshot directories
  1. SNAPPRE = snap prefix, usually N256L16 or similar (specified later)
  2. SNAPNUMS[j] = snapshot numbers (specified later)

• DIR_OPTS:

  0. SIMBASEDIR = base snapshot directory - specified in sim_config.py
  1. SNAPPRE = snap prefix, usually N256L16 or similar (specified later)
  2. DIRPRES[i] = prefix for subdirectories

Next we need to define SNAPPRE and DIRPRES. The first should be fairly self explanatory, the second specifies any sub directories that may exist within your snapshot directory. If you do not have any subdirectories under your snapshot folder simply set:

DIRPRES = ['.']

Last is the parameters ZOOM_RES and ZOOM_LOWRES*. The first sets the effective resolutuion of your simulation if it is detected to be a zoom; don’t worry about this for cosmological boxes. The second tells SPHGR which particles to consider low-resolution elements. The number is calculated via 2^particleType+2^particleType, so if particle types 2,3,&5 are low-resolution particles we would set this value to 2^2+2^3+2^5=44.

EXAMPLE

Let’s say you are working with a simulation snapshot whose full path is the following:

/home/rthompson/N512L32/snap_N512L32_050

This is what the configs/sim_config.py variables should look like for this particular sim:

SIMBASEDIR    = '/home/rthompson'
SNAPDIR       = '%s/%s'
SNAPDIR_OPTS  = '(%s,%s)' % (DIR_OPTS.get(0), DIR_OPTS.get(1))
SNAPNAME      = '%s/snap_%s_%03d'
SNAPNAME_OPTS = '(%s,%s,%s)' % (SNAP_OPTS.get(0),SNAP_OPTS.get(1),SNAP_OPTS.get(2))
SNAPPRE       = ['N512L32']
DIRPRES       = ['.']

reduction.py¶

Once configs/config.py and configs/sim_config.py are edited appropriately we need to setup the reduction script parameters.

• BEG/END: this determines what snap numbers the code will analyze. When working with a linear series of snapshots, say 0-100, set BEG=0, END=100. If you are working with a single snapshot set BEG=[N] and END will be ignored. Lastly, if your snapshots are not linearly spaced then you can set BEG=[a,c,k,l] and it will again ignore the value specified for END.

• SKIPRAN: code will skip the analysis if the result already exists. 0=do not skip, 1=skip

• PROMPT: code will prompt if files are not found, useful to disable if submitting jobs.

• RUN_XXX: allows you to switch on/off specific analysis processes. 0=do not run, 1=run.

  • SKID - galaxy group finding
  • ROCKSTAR - halo finding
  • MEMBERSEARCH - main analysis
  • PROGEN - most massive progenitor search
  • LOSER - Romeel’s LOSER code

• MPI_NP: Sets the number of processors to use for parallel analysis via mpi4py.

• OMP_NP: Number of threads to spawn for misc. calculations

NOTE: Only use PROGEN if you are planning on examining a sequence of snapshots, it requires more than one to work as it leapfrogs backwards looking for the previous sequential snapshot (SNAPNUM-1).

rto¶

pickleFile.rto.:

- DEBUG
- DS
- EPSILON_FACT
- GROUPDIRPREFIX
- HDF5
- TIPSY
- PERIODIC
- SKIPRAN
- SUPRESS
- zoomSim
- ZOOM_LOWRES
- localDensitySearchFactor
- pprogress
- pygr_OPTS
- snapnum_str

locs¶

pickleFile.locs.:

- GRID_DATA
- LOSER_DATADIR
- LOSER_FILES
- PROGEN_DIR
- PROGEN_GALAXY_FILE
- PROGEN_HALO_FILE
- RS_BINFILE
- RS_DIR
- RS_PARENTFILE
- SKID_DIR
- SKID_FILE
- SKID_GRPFILE
- SKID_STATFILE
- snap
- snapdir

constants¶

pickleFile.constants.:

- cm_per_mpc
- kpc_to_cm
- cm_to_kpc
- Msun_in_g
- protonmass_in_g
- c
- G
- Boltzmann
- cm_to_km
- H_He_mass_in_g
- UnitMass_in_g
- UnitLength_in_cm
- UnitVelocity_in_cm_per_s

conversionFactors¶

pickleFile.conversionFactors.:

- LCONVERT              # --> kpc
- MCONVERT              # --> Msun
- rconvert              # length conversion factor [1/(1+z)]
- vfactor               # velocity conversion factor [sqrt(a)]
- VCONVERT              # --> km/s
- RS_L_CONVERT          # RS length conversion factor --> Mpc/h
- RS_M_CONVERT          # RS mass conversion factor --> Msun/h
- TIPSY_L_convert       # TIPSY length conversion factor
- TIPSY_V_convert       # TIPSY velocity conversion factor
- TIPSY_M_convert       # TIPSY mass conversion factor
- TIPSY_RHO_convert     # TIPSY density conversion factor

snapAttribs¶

pickleFile.snapAttribs.:

- DM_ONLY               # set to 1 if this is a DM only sim
- redshift              # redshift
- time                  # scale factor
- h                     # hubble parameter
- O0                    # matter density
- Ol                    # vacuum energy density
- boxsize               # size of the box (no little h)
- boxsize_h             # size of the box (little h divided out)
- n_gas                 # number of type [0] gas particles
- n_star                # number of type [4] star particles
- n_dm                  # number of type [1] dm particles
- n_bulge               # number of type [3] bulge particles
- n_disk                # number of type [2] disk particles
- n_bndry               # number of type [5] bndry particles
- nparts                # list - [n_gas,n_dm,n_bulge,n_disk,n_star,n_bndry]
- nfiles                # number of files for this snapshot
- flagSFR               # SFR flag
- flagFB                # FB flag
- flagCooling           # Cooling flag
- flagAge               # Stellar Age flag
- flagFH2               # fH2 flag

particleData¶

pickleFile.particleData.:

- getParticleIDs()        # gives access to particle IDs
  - gIDs
  - sIDs
  - dmIDs
- getParticleData()       # gives access to particle data
  - gpos
  - gvel
  - gmass
  - grho
  - gTemp
  - gsfr
  - gHSML
  - gnh
  - gne
  - gZ
  - gfH2
  - zarray
  - spos
  - svel
  - smass
  - sZ
  - sage
  - dmmass
  - dmpos
  - dmvel
- deleteParticleIDs()     # removes particle IDs from memory
- deleteParticleData()    # removes particle data from memory
- cleanUp()               # removes PIDs and particle data

particleLists¶

pickleFile.particleLists.:

- getParticleLists()      # gives access to particle lists
  - halo_glist            # halo index membership for all gas
  - halo_slist            # halo index membership for all star
  - halo_dmlist           # halo index membership for all DM
  - halo_lrlist           # halo index membership for all lowres
  - galaxy_glist          # galaxy index membership for all gas
  - galaxy_slist          # galaxy index membership for all star
- deleteParticleLists()   # removes particle lists from memory

galaxies (galaxy class)¶

pickleFile.galaxies[N].:

- index                 # current index
- cm                    # x,y,z center-of-mass
- vel                   # x,y,z center-of-mass velocities
- HMR                   # half-mass-radius  (SKID)
- FMR                   # full-mass-radius  (SKID)
- stellar_FMR           # maximum stellar radius
- gas_mass              # total gas mass
- stellar_mass          # total stellar mass
- total_mass            # gas + stellar
- HImass                # HI mass
- H2mass                # H2 mass
- Hmass                 # H  mass
- HMR_cv                # circular velocity at HMR (SKID)
- FMR_cv                # circular velocity at FMR (SKID)
- max_cv                # maximum circular velocity
- max_cv_r              # radius at maximum vphi
- sigma1d               # 1D velocity dispersion
- central               # -1=unassigned, 0=satellite, 1=central
- originalIndex         # original SKID index
- sfr                   # total SFR
- Z                     # SFR-weighted metallicity
- mwZ                   # MASS-weighted metallicity
- [glist]               # indexes of gas particles that belong to this gal
- [slist]               # indexes of star particles that belong to this gal
- L                     # Lx,Ly,Lz angular momentum vector
- ALPHA                 # first rotation angle to align L with z-axis
- BETA                  # second rotation angle to align L with z-axis
- local_mass_density    # local mass density of galaxies
- local_number_density  # local number density of galaxies
- halo                  # parent :class:`halo` object
- halo_index            # index of corresponding RS halo
- halo_distance         # distance between galaxy CoM and halo CoM
- halo_dm_mass          # total DM mass within the halo
- halo_gmass            # total gas mass within the halo
- halo_smass            # total stellar mass within the halo
- halo_total_mass       # halo_gas + halo_star + halo_dm mass
- halo_mass             # total DM mass within the halo
- halo_isparent         # -1=parent, anything else is substructure

halos (halo class)¶

pickleFile.halos[N].:

- index                 # current index
- cm                    # x,y,z center-of-mass
- r200                  # radius
- maxrad                # maximum radius
- L                     # Lx,Ly,Lz angular momentum vector
- hparent               # -1=parent, anything else is substructure
- particle_count        # number of DM particles
- [galaxy_list]         # list of galaxy indexes contained within this halo
- [sub_halo_list]       # list of subhalo indexes contained
- [glist]               # indexes of gas particles that belong to this halo
- [slist]               # indexes of star particles that belong to this halo
- [dmlist]              # indexes of dm particles that belong to this halo
- [lrlist]              # list of low-res particles (if present)
- mass                  # virial mass given by RS
- dm_mass               # total DM mass within the halo
- gas_mass              # total gas mass within the halo
- stellar_mass          # total stellar mass within the halo
- total_mass            # gas + star + dm mass
- local_mass_density    # local mass density of halos
- local_number_density  # local number density of halos
- sfr                   # total SFR (all gas within)
- Z                     # SFR-weighted metallicity (all gas within)
- mwZ                   # MASS-weighted metallicity (all gas within)
- energy                #
- spin                  #
- vmax                  #
- rvmax                 #
- vrms                  #
- originalIndex         #
- sub_halos             # list of sub-halo objects
- galaxies              # list of contained galaxy objects