Documentation of the ROC processing of the USSR monthly data at NGDC.

Aug 1995 will be used for this example.  The month, year and station names 
will need to be changed to correspond with the content each month.   

0.  We create two directories for this effort, D:\temp & d:\FSU.  [prograns required in FSU directory are - nutoiiwg.exe, iiwghdr.dat, pkunzip.exe, optsort.exe, fixcr.exe, isortcr.exe, sub.exe and the data file.]

1.  unzip - use the file called pkunzip.exe aug95.zip (files are like named 
950800.mos for 1995, Aug, foF2 moscow) 

2.  merge all parameters file into a station month file - To do this we create a batch file that looks like the following.

COPY *.ros 1499508.RAW
COPY *.mos 1559508.RAW
COPY *.len 1609508.RAW
COPY *.tas 2419508.RAW
COPY *.sve 2569508.RAW
COPY *.sal 2669508.RAW
COPY *.nov 3559508.RAW
COPY *.tom 3569508.RAW
COPY *.pod 3629508.RAW
COPY *.dix 3739508.RAW
COPY *.pet 5539508.RAW
COPY *.mag 5609508.RAW

3.  add carrage returns and line feeds at the end of a 120 character line - To do this we create a batch file that looks like the following. 

fixcr.exe 1499508.RAW 1499508.ust 120 1
fixcr.exe 1559508.RAW 1559508.ust 120 1
fixcr.exe 1609508.RAW 1609508.ust 120 1
fixcr.exe 2419508.RAW 2419508.ust 120 1
fixcr.exe 2569508.RAW 2569508.ust 120 1
fixcr.exe 2669508.RAW 2669508.ust 120 1
fixcr.exe 3559508.RAW 3559508.ust 120 1
fixcr.exe 3569508.RAW 3569508.ust 120 1
fixcr.exe 3629508.RAW 3629508.ust 120 1
fixcr.exe 3739508.RAW 3739508.ust 120 1
fixcr.exe 5539508.RAW 5539508.ust 120 1
fixcr.exe 5609508.RAW 5609508.ust 120 1

4.  Correct headers with optsort.exe - This program will not rename so in order to not over write, put the new data to a different subdirectory (d:\temp). To make the following work, it must be put in a batch file like the following. 

FOR %%F IN (1499508.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"RV149000E04280397",38,E) FILETYPE(fix,4880)
FOR %%F IN (1559508.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"MO155000E03450373",38,E) FILETYPE(fix,4880)
FOR %%F IN (1609508.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"LD160000E03010307",38,E) FILETYPE(fix,4880)
FOR %%F IN (2419508.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"TQ241000E04870696",38,E) FILETYPE(fix,4880)
FOR %%F IN (2569508.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"SV256000E03360586",38,E) FILETYPE(fix,4880)
FOR %%F IN (2669508.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"SD266000E02350665",38,E) FILETYPE(fix,4880)
FOR %%F IN (3559508.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"NS355000E03540832",38,E) FILETYPE(fix,4880)
FOR %%F IN (3569508.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"TK356000E03350849",38,E) FILETYPE(fix,4880)
FOR %%F IN (3629508.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"TZ362000E02840900",38,E) FILETYPE(fix,4880)
FOR %%F IN (3739508.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"DI373000E01650804",38,E) FILETYPE(fix,4880)
FOR %%F IN (5539508.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"PK553000E03701587",38,E) FILETYPE(fix,4880)
FOR %%F IN (5609508.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"MG560000E03001510",38,E) FILETYPE(fix,4880)


5.  copy files back to d:\FSU directory.

cd D:\temp 
copy *.ust d:\FSU\*.hdr.

6.  Sort files with isortcr.exe - We want the file sorted by characteristic. To do this we create a batch file that looks:

ISORTCR 1499508.hdr 1499508.SRT
ISORTCR 1559508.hdr 1559508.SRT
ISORTCR 1609508.hdr 1609508.SRT
ISORTCR 2419508.hdr 2419508.SRT
ISORTCR 2569508.hdr 2569508.SRT
ISORTCR 2669508.hdr 2669508.SRT
ISORTCR 3559508.hdr 3559508.SRT
ISORTCR 3569508.hdr 3569508.SRT
ISORTCR 3629508.hdr 3629508.SRT
ISORTCR 3739508.hdr 3739508.SRT
ISORTCR 5539508.hdr 5539508.SRT
ISORTCR 5609508.hdr 5609508.SRT

7.  Convert *.SRT files to IIWG format & rename files to *.iwg - do the following.

nutoiiwg.exe *.SRT

9.  Load into SPIDR

iiwgload.sh (or what ever works on your node)


10. Check data in SPIDR & you are done.

PS:  This exact procedure will only work on Aug 1995 data as received at NGDC.  Modification must be made for differences.  This procedure can and should be made more automated and robust.