f:\ussr.dir\fusgetnn.des Usually, the data are E-Mailed from Olga to R. Conkright and G. Talarski. The following are a modification of the documentation that ROC supplied for processing Russian (former USSR) monthly ionospheric data. BE SURE THAT YOU HAVE ENOUGH SPACE FOR THE UNZIPPED FILES AND THE PROCESSED FILES (intermediate and final output files). Aug 1995 will be used for this example. The month, year and station names will need to be changed to correspond with the content each month. [prograns needed are - nutoiiwg.exe, iiwghdr.dat, pkunzip.exe, optsort.exe, fixcr.exe, isortcr.exe, mdriver.exe, median.exe, and sub.exe] STARTING with year 2000 data, you will have to edit the NEWURSI file and change the year from 3900 to 2000 or 3901 to 2001, etc., depending upon the year of the data. >>>BE SURE THAT THE IIWGHDR.DAT FILE IS CORRECT; IT SHOULD BE FOR<<< >>>MANUAL OR AUTOMATED DATA. THE SELDADS DATA FILE WITH THE <<< >>>SAME NAME, IIWGHDR.DAT, IS FOR 'REAL-TIME' DATA. <<< 1. unzip - use the file called pkunzip.exe aug95.zip (files are like named 950800.mos for 1995, Aug, foF2 moscow). Use pkunzip -o fn>err or pkunzip -o fn>yrmo.err so that you will have a copy of those files that have an error. Delete the error files and ask for them to be sent again. There have been no errors in several years. The error file will serve as a basis for what data files that need to be processed. This 'error' file will also identify the stations that have been received. The stations are needed for other processing 'programs'. 2. merge all characteristic (parameter) files into a station month file - do the following. This documentation can be copied and the following can be put in a batch file and corrected for the specific stations that appear in your directory after using the unzip command on the appropriate file. If you have a batch file, (ie. combine.bat), be sure to edit it so that it reflects the stations that were unzipped from the original file for that specific month. If you have other months in the same directory, move them to another directory, so that they do not get combined with the monthly data that you are processing. COPY *.ros 1499508.RAW (149=ros=Rostov) COPY *.mos 1559508.RAW (155=mos=Moscow) COPY *.len 1609508.RAW (160=len=Leningrad) COPY *.ark 1639508.RAW (163=ark=Arkhangelsk) COPY *.lop 1689508.RAW (168=lop=Loparskaya) COPY *.ash 2379611.RAW (237=ash=Ashkhabad) COPY *.tas 2419508.RAW (241=tas=Tashkent) COPY *.sve 2569508.RAW (256=sve=Sverdlovsk) COPY *.sal 2669508.RAW (266=sal=Salekhard) COPY *.irk 3529508.RAW (352=irk=IRKUTSK) COPY *.nov 3559508.RAW (355=nov=Novosibirsk) COPY *.tom 3560109.RAW (356=tom=Tomsk) COPY *.pod 3629508.RAW (362=pod=Podkamennaya) COPY *.dix 3739508.RAW (373=dix=Dikson) COPY *.pre 3740109.RAW (374=pre=Preobrazheniya) COPY *.kha 5480109.RAW (548=Khabarovsk) COPY *.pet 5539508.RAW (553=pet=Petropavlovsk) COPY *.mag 5609508.RAW (560=mag=Magadan) COPY *.wel 6670109.RAW (667=wel=Wellen) COPY *.cap 6690109.RAW (669=cap=Cape Schmidt) NOW edit DIKSON (373), ie. 3739508.raw if present, and change all "DIXON " to "DIKSON" before continuing to the next step. (There will not be CR/LF yet). NOTES: Ashkhabad (237) sometimes reports most of their foF2 values as '116'. Dikson (373) usually sends in 'C' for the whole month. 3. add carriage returns and line feeds - do the following. If you have a batch file, (ie. addcrlf.bat), be sure to edit it so that it reflects the stations that were unzipped from the original file for that specific month. fixcr.exe 1490109.RAW 1490109.ust 120 1 fixcr.exe 1550109.RAW 1550109.ust 120 1 fixcr.exe 1600109.RAW 1600109.ust 120 1 fixcr.exe 1630109.RAW 1630109.ust 120 1 fixcr.exe 1680109.RAW 1680109.ust 120 1 fixcr.exe 2370109.RAW 2370109.ust 120 1 fixcr.exe 2410109.RAW 2410109.ust 120 1 fixcr.exe 2560109.RAW 2560109.ust 120 1 fixcr.exe 2660109.RAW 2660109.ust 120 1 fixcr.exe 3550109.RAW 3550109.ust 120 1 fixcr.exe 3560109.RAW 3560109.ust 120 1 fixcr.exe 3620109.RAW 3620109.ust 120 1 fixcr.exe 3730109.RAW 3730109.ust 120 1 fixcr.exe 3740109.RAW 3740109.ust 120 1 fixcr.exe 5480109.RAW 5480109.ust 120 1 fixcr.exe 5530109.RAW 5530109.ust 120 1 fixcr.exe 5600109.RAW 5600109.ust 120 1 fixcr.exe 6670109.RAW 6670109.ust 120 1 fixcr.exe 6690109.RAW 6690109.ust 120 1 4. Correct headers with optsort.exe - use the following batch file. If you have a batch file, (ie. corrhdrs.bat), be sure to edit it so that it reflects the stations that were unzipped from the original file. FOR %%F IN (1490109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"RV149000E04280397",38,E) FILETYPE(fix,4880) FOR %%F IN (1550109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"MO155000E03450373",38,E) FILETYPE(fix,4880) FOR %%F IN (1600109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"LD160000E03000307",38,E) FILETYPE(fix,4880) FOR %%F IN (1630109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"AZ163000E02540405",38,E) FILETYPE(fix,4880) FOR %%F IN (1680109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"MM168000E02200330",38,E) FILETYPE(fix,4880) FOR %%F IN (2370109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"AS237000E05210583",38,E) FILETYPE(fix,4880) FOR %%F IN (2410109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"TQ241000E04870696",38,E) FILETYPE(fix,4880) FOR %%F IN (2560109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"SV256000E03360586",38,E) FILETYPE(fix,4880) FOR %%F IN (2660109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"SD266000E02350665",38,E) FILETYPE(fix,4880) FOR %%F IN (3550109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"NS355000E03540832",38,E) FILETYPE(fix,4880) FOR %%F IN (3560109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"TK356000E03350849",38,E) FILETYPE(fix,4880) FOR %%F IN (3620109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"TZ362000E02840900",38,E) FILETYPE(fix,4880) FOR %%F IN (3730109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"DI373000E01650804",38,E) FILETYPE(fix,4880) FOR %%F IN (3740109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"PZ374000E01531130",38,E) FILETYPE(fix,4880) FOR %%F IN (5480109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"KB548000E04151351",38,E) FILETYPE(fix,4880) FOR %%F IN (5530109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"PK553000E03701587",38,E) FILETYPE(fix,4880) FOR %%F IN (5600109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"MG560000E03001510",38,E) FILETYPE(fix,4880) FOR %%F IN (6670109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"WE667000E02241902",38,E) FILETYPE(fix,4880) FOR %%F IN (6690109.ust) DO OPTSORT %%F d:\temp\%%F /OUTREC(1,20,"CE669000E02121795",38,E) FILETYPE(fix,4880) 5. Sort files with isortcr.exe - use the following batch file. If you have a batch file, (ie. sortall.bat), be sure to edit it so that it reflects the stations that were unzipped from the original file for that specific month. Be sure that you are getting the latest '*.ust' file from the correct directory. ISORTCR d:\temp\1490109.ust 1499508.SRT (149=ros=Rostov) ISORTCR d:\temp\1550109.ust 1559508.SRT (155=mos=Moscow) ISORTCR d:\temp\1600109.ust 1609508.SRT (160=len=Leningrad) ISORTCR d:\temp\1630109.ust 1639508.SRT (163=ark=Arkhangelsk) ISORTCR d:\temp\1680109.ust 1689508.SRT (168=lop=Loparskaya) ISORTCR d:\temp\2370109.ust 2379508.SRT (237=ash=Ashkhabad) ISORTCR d:\temp\2410109.ust 2419508.SRT (241=tas=Tashkent) ISORTCR d:\temp\2560109.ust 2569508.SRT (256=sve=Sverdlovsk) ISORTCR d:\temp\2660109.ust 2669508.SRT (266=sal=Salekhard) ISORTCR d:\temp\3550109.ust 3559508.SRT (355=nov=Novosibirsk) ISORTCR d:\temp\3560109.ust 3569508.SRT (356=tom=Tomsk) ISORTCR d:\temp\3620109.ust 3629508.SRT (362=pod=Podkamennaya) ISORTCR d:\temp\3730109.ust 3739508.SRT (373=dix=Dikson) ISORTCR d:\temp\3740109.ust 3740109.SRT (374=pre=Preobrazheniya) ISORTCR d:\temp\5480109.ust 5480109.SRT (548=kha=Khabarovsk) ISORTCR d:\temp\5530109.ust 5539508.SRT (553=pet=Petropavlovsk) ISORTCR d:\temp\5600109.ust 5609508.SRT (560=mag=Magadan) ISORTCR d:\temp\6670109.ust 6670109.SRT (667=wel=Wellen) ISORTCR d:\temp\6690109.ust 6690109.SRT (669=cap=Cape Schmidt) *** If year is incorrect, correct them (ie. 3901 to 2001). *** --------------------------------------------------------------------------- If you have IONOPE.EXE, run this quality control program now. You will probably have changes to make to at least one file. Then, you can do the calculations of the monthly summaries (median, count, etc.) --------------------------------------------------------------------------- *** IONOPE.EXE program only works on computer CD0000497372 in *** *** George E. Talarski's office, which has a special display *** *** board installed. Without this display board, the program *** *** will not work. The program works in DOS. Be sure that *** *** your input files are copies, in case you make a change *** *** with the program and decide that you made an error. Once *** *** a change has been made with the program, the change is *** *** written to your data file. One problem with the program *** *** is any numeric value less than three bytes will have a *** *** leading zero added to it. You may have to edit the file *** *** after you have done the QC on the file, as archive data *** *** should not have a leading zero. *** If you have IONOPE.EXE, run this quality control program now. You will probably have changes to make to at least one file. Then, you can do the calculations of the monthly summaries (median, count, etc.) --------------------------------------------------------------------------- MONTHLY SUMMARIES (MEDIANS) are done by SPIDR II! 6. Calculate Monthly summaries - use the following batch file. mdriver *.srt d:\temp OR (mdriver ???yrmo.srt d:\temp) 7. rename file to standard ursi convention - - do the following. copy d:\temp\*.srt *.nut 8. Run a quality control program to display and correct any errors that may be present. IF THERE ARE ERRORS, you must go back and recalculate the MONTHLY SUMMARIES. 9. Convert to IWG format - do the following. nutoiiwg.exe *.nut NOW check the nutoiiwg.err file for problems. If you have errors, they must be corrected. You can rerun most of the procedure, but run the individual station rather than the macro for all stations. 10. Edit your IWG files and correct the fmin factor of '0.01...' to ' 0.1...'! 11. Run hmf2.exe on the data file to produce the IDG file. 12. Transfer the data to the appropriate Linex directory and load the data. Then, do an update so that the data are on SPIDR.