CMDL aerosol data flow (98-02-10)
Input data | FIELD PC pgm | When/How | Output data |
field sensors | CP.EXE | 0000Z daily by CP | field: \cp\run\[AM]*.RAW |
field: \cp\run\*.RAW |
ARCHIVE.CMD | 0100Z by CRONTAB.CMD | field: \cp\work\*.RAW |
field: \cp\work\*.RAW |
copy | 0100Z by ARCHIVE.CMD | field: \cp\raw\*.RAW |
field: \cp\work\*.RAW |
ZIP.EXE | 0100Z by ARCHIVE.CMD | field: \cp\archive\raw\r*.zip |
field: \cp\work\*.RAW |
CONVERT.EXE | 0100Z by ARCHIVE.CMD | field: \cp\work\*.TXT |
field: \cp\work\*.TXT |
ZIP.EXE -m | 0100Z by ARCHIVE.CMD | field: \cp\archive\t9*.zip |
field: \cp\archive\t9*.zip |
move | early morning by GETSTN.CMD | field: \cp\archive\boulder\t9*.zip |
field: \cp\raw\*.RAW |
del | manually when disk space gets low, or DELOLD.CMD from CRONTAB.CMD | |
Input data | LAB PC pgm | When/How | Output data |
field: \cp\archive\t9*.zip |
zmodem or ftp file transfer | early morning by GETSTN.CMD from CRONTAB.CMD | lab: \scratch\t9*.zip |
lab: \scratch\t9*.zip |
copy | early morning by MOVESTN.CMD from GETSTN.CMD | cmdl3:/aerosol/stn/archive/raw/ zip/t9*.zip |
lab: \scratch\t9*.zip |
unzip | early morning by MOVESTN.CMD from GETSTN.CMD | cmdl3: /aerosol/stn/new/[AM]*.TXT |
lab: \scratch\t9*.zip |
move | early morning by MOVESTN.CMD from GETSTN.CMD | lab: \cp\stn\archive\raw\t9*.zip |
Input data | UNIX pgm | When/How | Output data |
cmdl3:/aerosol/stn/ [AM]*.TXT |
stn.new | early morning by crontab, or manually | cmdl3:/aerosol/stn/new/ ??_cum.stn ??_X.stn |
cmdl3:/aerosol/stn/new/ ??_cum.stn |
editWeek | each week, by QC scientist | cmdl3:/aerosol/stn/new/ qc/a_eYYwXX.stn ??_X.stn |
cmdl3:/aerosol/stn/new/ qc/a_eYYwXX.stn |
pass | by QC scientist | cmdl3:/aerosol3/aerosol/net/ stn/phys/a_eYYwXX.stn |
cmdl3:/aerosol/stn/new/ qc/a_eYYwXX.stn |
fail | by QC scientist | cmdl3:/aerosol/stn/new/ qc/fail/a_eYYwXX.stn |
cmdl3:/aerosol/stn/new/ qc/fail/a_eYYwXX.stn |
editWeek (iterative loop until QC passes) | by QC scientist, after re-editing STN_LOG.XLS | cmdl3:/aerosol/stn/new/ qc/a__YYwXX.stn ??_X.stn |
cmdl3:/aerosol3/aerosol/ net/stn/phys/ a_eYYwXX.stn |
archiveClean | by data aide, after each full quarter has passed QC | cmdl3:/aerosol3/aerosol/ net/stn/phys/ a__YYQx.stn.zip |
cmdl3:/aerosol3/aerosol/ net/stn/phys/ a_eYYwXX.stn |
avg -a -h < a_e.. avg -A -d < a_H.. |
by data aide, after each full quarter has passed QC | cmdl3:/aerosol3/aerosol/ pub/stn/archive/ a_HYYQxstn.zip a_DYYQxstn.zip |
cmdl3:/aerosol3/aerosol/ pub/stn/archive/ a_HYYQxstn.zip a_DYYQxstn.zip |
consolidateQtr | by data aide, after each full year has passed QC | cmdl3:/aerosol3/aerosol/ pub/stn/archive/ a_HYYstn.zip a_DYYstn.zip a_MYYstn.zip |
cmdl3:/aerosol/stn/new/ ??_cum.stn |
splitQtr | by data aide, after each quarter is ended | cmdl3:/aerosol2/archive/stn/raw/qtr/rYYQxstn.zip |
cmdl3:/aerosol/stn/ archive/raw/zip/t9*.zip |
mv | by crontab, daily | cmdl3:/aerosol2/archive/stn/raw/day/t9*.zip |