RVP8 User’s Manual March 2006 5. Processing Algorithms Processing Algorithms Note: Optional dual polarization processing algorithms are described in Appendix B. This chapter describes the processing algorithms implemented within the RVP8 signal processor. The discussion is confined to the mathematical description of these algorithms. Figure 5–1 shows the overall process by which the RVP8 converts the IF signal into corrected reflectivity, velocity, and width.
RVP8 User’s Manual March 2006 Processing Algorithms where this angle lies between * p and ) p and the signs of Real{s} and Imag {s} determine the proper quadrant. Note that this angle is real, and is uniquely defined as long as |s| is non-zero. When |s| is equal to zero, Arg{s} is undefined. Finally, the “complex conjugate” of “s” is that value obtained by negating the imaginary part of the number, i.e., s * + Real{s } * j Imag{s }. Note that Arg{s*} = –Arg{s}.
RVP8 User’s Manual March 2006 Processing Algorithms Figure 5–1: Flow Diagram of RVP8 Processing dBT dBZ VW Speckle Remover SIGTH LOGTH SQITH CCORTH FLAGS Thresholding dBZ N l dBZ 0 V W SQI SIG CCOR dBT Calibrate Moments Calculate Output Data a K–bins Range Averaging CCORTH Micro Clutter Suppression R0 R1 (R2) T0 Clutter Filtering and Autocorrelation by Time Domain or Frequency Domain Approach Correlate M Filter AFC D/A s i (I and Q) FFT Compute Frequency A/D Correlate FIR Decimate
RVP8 User’s Manual March 2006 5.1 Processing Algorithms IF Signal Processing The starting point for all computations within the RVP8 are the instantaneous IF-receiver samples p n and, the instantaneous burst-pulse or COHO reference samples b n . These data are available at a very high sampling rate (typically 36MHz), which makes possible the digital implementation of functions that are traditionally performed by discrete components in an analog receiver.
RVP8 User’s Manual March 2006 Processing Algorithms where f IF is the radar intermediate frequency, f SAMP is the RVP8/IFD crystal sampling frequency, and l n are the coefficients of an N-point symmetric low-pass FIR filter that is matched to the bandwidth of the transmitted pulse. The multiplication of the l n terms by the sin() terms effectively converts to the low-pass filter to a band-pass filter centered at the radar IF.
RVP8 User’s Manual March 2006 Processing Algorithms Mode-1: Dual-Pol On Two Frequencies This was the original dual-Pol configuration used by the RVP7 several years ago. A single IFD A/D converter receives the “H” and “V” channels using two distinct intermediate frequencies. Two different STALOs are required in this configuration, making the RF/IF components a bit more expensive, but only one IFD is required.
RVP8 User’s Manual March 2006 Processing Algorithms tion of the final (I,Q) noise floor. But suppose we wanted to send two A/D waveforms down the same data link by interleaving the samples together. Each channel would have to be down-sampled to 36MHz in order to fit within this format, but that would cause its (I,Q) noise floor to increase by 3dB.
RVP8 User’s Manual March 2006 Processing Algorithms maximum separation, the overlap of the low gain channel and the high gain channel is zero -- we begin using one as soon as the other has begun to saturate. We see that there can be a large difference between the absolute minimum and maximum signal level separations; thus additional criteria must be considered to choose an optimum value that is between these diverse limits. Choosing a proper separation value is a tradeoff of several factors.
RVP8 User’s Manual March 2006 5.1.3 Processing Algorithms Automatic Frequency Control (AFC) AFC is used on magnetron systems to tune the STALO to compensate for magnetron frequency drift. It is not required for Klystron systems. The STALO is typically tuned 30 or 60 MHz away from the magnetron frequency. The maximum tuning range of the AFC feedback is approximately 7MHz on each side of the center frequency.
RVP8 User’s Manual March 2006 Processing Algorithms The Burst Pulse Tracker and AFC feedback loop are each fine-tuning servos that keep the burst pulse “centered” in time and frequency. These servos have been expanded to include a combined “Hunt Mode” that will track down a missing burst pulse when we are uncertain of both its time and frequency. This coarse-tuning mode is especially valuable for initializing the two fine-tuning servos in radar systems that drift significantly with time and temperature.
RVP8 User’s Manual March 2006 Processing Algorithms then (I n, Q n) is replaced by (I n*1, Q n*1) . Here C 1 and C 2 are constants that can be tuned by the user to match the type of interference that is anticipated, and the error rates that can be tolerated. For certain environments it may be the case that good results can be obtained with C 1 + C 2 ; but the RVP8 does not force that restriction.
RVP8 User’s Manual March 2006 Processing Algorithms It is important to minimize both types of errors. If too much interference is missed, then the filter is not doing an adequate job of cleaning up the received signal. If the false alarm rate is too high, then background damage is done at all times and the overall signal quality (especially sub-clutter visibility) may be compromised.
RVP8 User’s Manual March 2006 5.1.6 Processing Algorithms Large-Signal Linearization The RVP8 is able to recover the signal power of targets that saturate the IF-Input A/D converter by as much as 4–6 deciBels. This is possible because an overdriven IF waveform still spends some of its time in the valid range of the converter, and thus, it is still possible to deduce information about the signal.
RVP8 User’s Manual March 2006 Processing Algorithms Longer time constants do a better job, but will require a second or two before valid data is available when the transmitter is first turned on. The default value of 70 will give excellent results in almost all cases. Whenever the RVP8 enters a new internal processing mode (time series, FFT, PPP, etc.
RVP8 User’s Manual March 2006 Processing Algorithms 5.2 Time Series (“I” and “Q”) Signal Processing 5.2.1 Time Series Processing Overview This section describes the processing of the radar time series data (also called linear “video” or “I” and “Q”) to obtain the meteorologically significant “moment” parameters: reflectivity, total power, velocity, width, signal quality index, clutter power correction, and optional polarization variables.
RVP8 User’s Manual March 2006 Processing Algorithms was developed to support a US WSR88D legacy requirement. It is not supported in SIGMET’s IRIS software. The time and frequency domain approaches are described in the sections below.
RVP8 User’s Manual March 2006 5.2.2 Processing Algorithms Frequency Domain Processing- Doppler Power Spectrum The Doppler power spectrum, or simply the “Doppler spectrum”, is the easiest way to visualize the meteorological information content of the time series. The bottom part of Figure 5–3 shows an example of a Doppler power spectrum for the time series shown in the upper part of the figure. The figure above shows the various components of the Doppler spectrum, i.e.
RVP8 User’s Manual March 2006 Processing Algorithms window is shown in the figure below which illustrates how the edge points of the time series are de–emphasized and the center points are over emphasized. The dashed line would correspond to the rectangular window. Note that the “gain” of the window is set to preserve the total power.
RVP8 User’s Manual March 2006 Processing Algorithms lowest variance estimates of the moment parameters (in the absence of clutter. More “aggressive” windows have lower side lobe power at the expense of a broader impulse response and an increased variance of the moment estimates.
RVP8 User’s Manual March 2006 5.2.3 Processing Algorithms Autocorrelations The final spectrum moment calculation (for total power or SNR, mean velocity and spectrum width) in all processing modes is based on autocorrelation moment estimation techniques. Typically the first three lags are calculated, denoted as R0, R1 and R2. However, there are two ways to calculate these, i.e., time domain or frequency domain calculation.
RVP8 User’s Manual March 2006 5.2.4 Processing Algorithms Angle Synchronization The exact value of M that is used for each time average will generally be the “Sample Size” that is selected by the SOPRM command (See Section 6.3). However, when the RVP8 is in PPP mode and antenna angle synchronization is enabled, the actual number of pulses used may be limited by the number that fit within each ray’s angular limits at the current antenna scan rate.
RVP8 User’s Manual March 2006 Processing Algorithms S Type 0: Fixed width filters with interpolation S Type 1:Variable width single slope adaptive processing S Type 2: Gaussian model adaptive processing (GMAP) These filters are described in in the sections detail below.
RVP8 User’s Manual March 2006 5.2.5.1 Processing Algorithms Fixed Width Clutter Filters This filter, illustrated in Figure 5–6, removes a specified number of spectrum components (5 in the example) and then interpolates across the gap using the minimum of a specified number of “edge points” (2 in the example) to anchor the interpolation at each end of the gap. This is a fairly simple legacy approach that uses interpolation to repair the damage caused by the removal of components.
RVP8 User’s Manual March 2006 5.2.5.2 Processing Algorithms Variable Width Clutter Filter This is similar in many ways to the fixed width filter except that the algorithm attempts to extend the boundary of the clutter by determining which is the first component outside the clutter region to increase in power. The filter is illustrated in the figure below.
RVP8 User’s Manual March 2006 5.2.5.3 Processing Algorithms Gaussian Model Adaptive Processing (GMAP) GMAP is a new adaptive technique developed at SIGMET that is possible on a high-speed processor such as the RVP8. GMAP has the following advantages as compared to fixed width frequency domain filters or time domain filtering such as the IIR approach: S The width adapts in the frequency domain to adjust for the effects of PRF, number of samples and the absolute amplitude of the clutter power.
RVP8 User’s Manual March 2006 Processing Algorithms Power dB Figure 5–8: GMAP Algorithm Steps Step 1: Window and DFT Apply window and DFT the input time series to obtain the Doppler power spectrum. A Hamming window is used for the first trial.
RVP8 User’s Manual March 2006 Processing Algorithms S As mentioned in Section 5.2.2, when there is no or very little clutter, use of a rectangular weighting function leads to the lowest-variance estimates of intensity, mean velocity and spectrum width. When there is a very large amount of clutter, then the aggressive Blackman window is required to reduce the “spill-over” of power from the clutter target into the sidelobes of the impulse response function. The Hamming window is used as the first guess.
RVP8 User’s Manual March 2006 Processing Algorithms S Finally there are two outputs from this step: a spectrum noise level and a list of components that are either signal or clutter S Step 3: Remove the clutter points The inputs for this step are the Doppler power spectrum, the assumed clutter width in m/s and the noise level, either known from noise measurement or optionally calculated from the previous step.
RVP8 User’s Manual March 2006 Processing Algorithms performed to obtain the autocorrelation at lags 0, 1. This is very computationally efficient since there are typically few remaining points and only the first two lags need be calculated. The pulse pair mean velocity and spectrum width are calculated using the Gaussian model (e.g., see Doviak and Zrnic, 1993). Note that since the noise has already been removed, there is no need to do a noise correction.
RVP8 User’s Manual March 2006 Processing Algorithms study was based on a built-in simulator that is provided as part of the RVP8 and the ascope utility. The simulator allows users to construct Doppler spectra, process them and evaluate the results (Sirmans and Bumgarner, 1975). This is an essential tool for evaluating the system performance. Figure 5–9 shows an example of the simulations for the very difficult case when the weather has zero velocity, i.e., it is perfectly overlapped with clutter.
RVP8 User’s Manual March 2006 Processing Algorithms Figure 5–9: GMAP example Weather only Weather plus clutter Simulation Characteristics Power Vel Width Clutter 0 0 0.012 PRF 1000 Hz Mode FFT Weather –40 0 0.1 Window Samples Units dB Any Normalized Blackman 64 “Mag Spec”: Doppler Spectrum in dB Units spanning the Nyquist interval. “Velocity”: Mean velocity of the spectrum in over Nyquist interval. Mean “m” and standard deviation values “s” are for the normalized interval ±1.
RVP8 User’s Manual March 2006 5.2.6 Processing Algorithms Range averaging and Clutter Microsuppression The next step (optional) is to perform range averaging. Range averaging can be performed over 2, 3, ..., 16 bins. This is accomplished by simply averaging the T 0 , R 0 , R 1 and R 2 values. This reduces the number of bins in the final output to save processing both in the RVP8 and in the host computer.
RVP8 User’s Manual March 2006 Processing Algorithms Essentially, the measurement of Io is based on the measurement of the system noise at the time of calibration. However, if the receiver gain were to change after calibration, the use of periodic noise sampling properly corrects for this. For example, if the receiver gain were to change by a factor k, then we would measure a noise value of kN and an autocorrelation value of kTo, i.e.
RVP8 User’s Manual March 2006 5.2.8 Processing Algorithms Velocity For a Doppler power spectrum that is symmetric about its mean velocity, the velocity is obtained directly from the argument of the autocorrelation at the first lag, i.e., V + l q 4pt s 1 where q 1 + arg NJR 1Nj . l is the radar wavelength, t s is the sampling time (1/PRF). q 1 is constrained to be on the interval [* p, p] . When q 1 +" p , then V +" V u where the unambiguous velocity is , l .
RVP8 User’s Manual March 2006 Processing Algorithms where “ln” represents the natural logarithm. This can be compared to the expression in the preceding section for SQI to illustrate that this expression for the variance is only valid when: SNR [ 1 SNR ) 1 which occurs when the SNR is large. This variance estimator is normalized to the Nyquist interval in units of [* p, p] .
RVP8 User’s Manual March 2006 5.2.11 Processing Algorithms Clutter Correction (CCOR threshold) In addition to calculating the R 0 , R 1 and optional R 2 autocorrelation terms, which are based on filtered time series data, the RVP8 also computes T 0 which is the total unfiltered power. By comparing the total filtered and unfiltered powers at each range bin, a clutter power, and hence a clutter correction, for that bin can be derived.
RVP8 User’s Manual March 2006 5.2.12 Processing Algorithms Weather Signal Power (SIG threshold) A parameter called SIG is also calculated to provide an estimate of the weather signal-to-noise ratio in dB for thresholding. The SIG calculation is different depending on the whether the optional R 2 autocorrelation is computed. R 0, R 1 Calculation In this case the SIG is computed as follows: SIG + 10 log ƪT *N Nƫ ) CCOR 0 This term represents the SNR after the removal of clutter.
RVP8 User’s Manual March 2006 5.3 Processing Algorithms Thresholding An important feature of the RVP8 is its ability to accept or reject incoming data based on derived properties of the signals themselves. Typically, “rejected” data are not displayed by the user’s software, thus making for very clean weather presentations. 5.3.1 Threshold Qualifiers For data quality control, each RVP8 output parameter can be qualified, i.e.
RVP8 User’s Manual March 2006 Processing Algorithms Parameter Description Threshold dBZ dBT V W ZDR Reflectivity with clutter correction Reflectivity without clutter correction Mean velocity Spectrum width Differential reflectivity LOG and CCOR LOG SQI and CCOR SQI and CCOR and SIG LOG 5.3.2 Adjusting Threshold Qualifiers The effect of the various threshold qualifiers for each output parameter are discussed in this section.
RVP8 User’s Manual March 2006 Processing Algorithms is traditionally used to qualify LOG data only in the Random Phase processing mode. But the secondary SQI threshold is applied uniformly in all processing modes whenever reflectivity data are specified as being thresholded by SQI. This gives you more freedom in applying an SQI threshold to your LOG data, because the cutoff value for reflectivity can be chosen independently from the cutoff value for the other Doppler parameters.
RVP8 User’s Manual March 2006 Input Ray Output Ray ÂÂ ÂÂ ÂÂ ÂÂ Processing Algorithms ÂÂÂÂÂÂÂÂÂ ÂÂÂÂÂÂÂÂÂ ÂÂÂÂÂÂÂÂÂÂÂÂÂ ÂÂÂÂÂÂÂÂÂÂÂÂÂ ÂÂ ÂÂ ÂÂ 1D Speckle Filtering X X Indicates Thresholded Bin Range X Indicates Valid Bin Indicates Speckle 2D 3x3 Speckle Filter The 2D filter examines three adjacent range bins from three successive rays in order to assign a value to the center point. Thus, for each output point, its eight neighboring bins in range and time are available to the filter.
RVP8 User’s Manual March 2006 Processing Algorithms 2D 3x3 Filtering Concepts ÂÂÂ ÂÂÂÂ ÂÂÂ ÂÂÂÂÂÂÂÂÂÂ ÂÂÂ ÂÂÂ ÂÂÂ ÂÂÂ ÂÂÂ ÂÂÂ Threshold if center point is valid but there are no or only one valid neighbor. 1 Azimuth Z 00 0 Z 0*1 -1 Range -1 0 Z 1 output 00 + Threshold Fill thresholded center point with average if there 6 or more valid neighbors.
RVP8 User’s Manual March 2006 Processing Algorithms 2D filter mitigates much of the damage that is caused at the 2nd trip seam to make a nearly seamless display.
RVP8 User’s Manual March 2006 5.4 Processing Algorithms Reflectivity Calibration The calculation of reflectivity described in Section 5.2.7 required the calibration reflectivity dBZ o . This section describes it’s derivation. You can use the zauto utility to perform the calibration. (See the IRIS/RDA Utilities Manual.) 10Log(Io ) Model Intensity Curve –5dB SNR Min Detectable RVP8 Measured Power (2dB per Major Div) Figure 5–10 1.
RVP8 User’s Manual March 2006 Processing Algorithms The measured receiver noise is the horizontal asymptote of the red curve, i.e., the value of the red curve when the input power PIN is zero: 10 log 10( N ) + G dB ) 10 log 10( I o ) . Intersecting this measured noise level with the green straight line gives: G dB ) 10 log 10( Io ) + GdB ) 10 log 10( P IN ) From which we see that the input power at the point of intersection is, indeed, Io .
RVP8 User’s Manual March 2006 Processing Algorithms S Turn the radiate off and connect the signal generator to the test signal injection point. S Raise the antenna to at least 20 degrees, and set the azimuth to point away from any known RF sources including the sun. S Select the pulse width using the mt command. S Select the pr command and use the commands to set the following: Plotting Received Power Spectrum... Rx:Pri, Zoom:x1–x8, Navg:25, Start:100.01 usec (14.
RVP8 User’s Manual March 2006 Processing Algorithms The equivalent power at the feed is then 3 dB more than this dBm Feed = –82+3 = –79 dBm. During the calibration, there are several ways to handle the losses using these equations. Two examples are: S Each signal generator value can be corrected for losses so that the calibration plot shows IFD measured power vs received power at the feed. This is recommended for manual calibration.
RVP8 User’s Manual March 2006 Processing Algorithms where, l Radar wavelength in cm. Pt Transmitted peak power in kW. Lt Transmit loss (e.g., 3 dB corresponds to L t + 2 ) t Pulse width in microseconds. q Horizontal half-power full beamwidth. f Vertical half-power full beamwidth. G Antenna gain (dimensionless) on beam axis. The radar constant is determined from the characteristics of your radar (check with the manufacturer if you are unsure of the values).
RVP8 User’s Manual March 2006 5.5 Processing Algorithms Dual PRT Processing Mode The RVP8 supports two major modes for Dual PRT processing, i.e., algorithms using triggers that consist of alternate short and long periods. Most of the Doppler parameters are available in each of these modes. You may also request time series data in both cases; the samples will be organized so that the first pulse of a short PRT pair always comes first. 5.5.
RVP8 User’s Manual March 2006 5.5.2 Processing Algorithms DPRT-2 Mode The trigger consists of alternating short and long period pulses, where the ratio of the periods is determined by the velocity unfolding ratio that has been selected. Doppler data are extracted from both the short and long pulse pairs (hence the “-2” suffix), and unfolded velocities are made available on each ray based on the combined PRT data from that ray alone.
RVP8 User’s Manual March 2006 5.6 Processing Algorithms Dual PRF Velocity Unfolding For a radar of wavelength l operating at a fixed sampling period t s + 1ńPRF , the unambiguous velocity and range intervals are given by: Vu + l 4t s Ru + c and ts 2 where “c” is the speed of light. Often these intervals do not fully cover the span of velocity and range that one would like to measure.
RVP8 User’s Manual March 2006 Processing Algorithms Now if t l and figuret h are in a 3:2 ratio, then: tl * th + and thus Vu unfold tl t + h 3 2 + 3V ul + 2V uh The angle f represents a velocity phase angle in [* p, p] , but with respect to an enlarged unambiguous interval. Thus, by simply differencing the folded angles from the high and low PRFs, we obtain an angle that is unfolded to a larger velocity span.
RVP8 User’s Manual March 2006 Processing Algorithms nearest the difference angle, we conclude that this is the correct unfolding. Likewise, on the left diagram we unfold the low-PRF angle by dividing the plane into thirds centered on the difference angle. The result angle is either ql , 3 q l 2p ) 3 3 or q l 4p ) 3 3 depending on which one falls into the acceptance Region 1. Note that the resultant angle is the same in each case.
RVP8 User’s Manual March 2006 Processing Algorithms points. However, there is a useful work-around in the RVP8 to minimize their impact — turning the clutter filter off at far ranges where little clutter is expected and using a narrow clutter filter minimizes the effects of the clutter filter on weather targets. The 4:3 and 5:4 PRF unfolding ratios are more susceptible to unfolding errors in cases where the spectrum width is large and/or the SNR is low.
RVP8 User’s Manual March 2006 Processing Algorithms 5.7 Random Phase 2nd Trip Processing 5.7.1 Overview Second trip echoes can be a serious problem for applications when the radar is operated at high PRF (e.g., >500 Hz). Second trip echoes are caused by the range aliasing of targets. They appear as false echoes on the display, usually elongated in the radial direction. On Klystron systems they will have valid Doppler velocities.
RVP8 User’s Manual March 2006 Processing Algorithms Another way to implement a magnetron system is to let the COHO free-run (rather than phase locking to the transmit pulse), measure the phase of each transmit pulse and digitally correcting for the transmit phase. Using this digital phase locking technique, the RVP8 can phase lock or “cohere” to either the first or the second trip.
RVP8 User’s Manual March 2006 Processing Algorithms algorithms check whether the SQI of each recovered trip is less than the secondary SQI threshold, and if so, the LOG portion of the data are rejected. This SQI test is necessary for a clean LOG picture, but we need to use a more permissive (lower) threshold value than would usually be applied to the Doppler data alone.
RVP8 User’s Manual March 2006 Processing Algorithms Random Phase and Dual PRF The random phase processing works seamlessly with the dual PRF processing to provide advanced range and velocity ambiguity resolution. Both the first and 2nd trip echoes can be recovered and displayed to a maximum range of 2X the unambiguous range corresponding to the high PRF. For optimum performance, the 2D 3x3 speckle filter should be used to smooth the 2nd trip seams that occur for each ray.
RVP8 User’s Manual March 2006 Processing Algorithms Figure 5–14: Random Phase Processing Algorithm Ideal 1st Trip Ideal 2nd Trip Raw 1st Trip with 2nd Trip Noise Contamination Raw 2nd Trip with 1st Trip Noise Contamination Filtered 1st Trip Filtered 2nd Trip Inverse Transfrom and ReĆCohere Recovered 1st Trip Recovered 2nd Trip 5–59
RVP8 User’s Manual March 2006 5.8 Processing Algorithms Signal Generator Testing of the Algorithms This section describes a variety of IF signal generator tests that can be used to verify correctness of the RVP8 processing algorithms. These tests are routinely performed at SIGMET whenever new algorithms and/or major modes are added to the processor.
RVP8 User’s Manual March 2006 5.8.2 Processing Algorithms Verifying PHIDP and KDP The PHIDP and KDP processing algorithms can be tested using CW signal sources at IF. In the alternating-transmitter single-receiver case, a single FM signal generator is modulated with an RVP8 polarization select line so that slightly different frequencies are generated for the H and V pulses. A maximum FM depth of several kilohertz is all that is required.
RVP8 User’s Manual March 2006 Processing Algorithms If we solve this equation for SQI=0.5 we find that the individual S A terms must have twice the power of the individual S B terms. This can be checked by adjusting either signal generator until the minimum plotted SQI is 0.5, and then verifying that the average H and V powers are identical; or, equivalently, that ZDR, LDRH and LDRV are zero. The linear FM ramp described in Section 5.8.1 can also be used as a test of RHOAB in a dual-receiver system.