CHAPTER 3
PERFORMANCE EVALUATION OF THE BFP OPTIONS

Chapter 2 narrowed the BFP options available for further analysis from 32 down to 11. The purpose of this chapter is to subject each of these 11 options to as much econometric analysis as is possible within the constraints of the data available for such analysis. Recognizing that there may be an interest in seeing how the options excluded in step 1 performed under the same analytical rigor, Appendix D provides the same detailed analytical results for all of the 32 options.

Criteria

Chapter 1 set forth the three criteria utilized in the step 2 analysis. In summary form, these included:

Basic Analytical Procedure

Many different ways of evaluating the 11 BFP options were discussed and evaluated. The desire of the USC was to select an analytical procedure that could be applied uniformly across as many of the options as possible within the time constraints imposed by the decision process set forth by the Secretary. In addition, USC wanted a technique that would require few assumptions on how participants would perform under alternative BFP options. The procedure selected is referred to as vector autoregression (VAR). This procedure is designed to analyze the relationship of economic data over time, otherwise referred to as time series analysis. Although VAR is not the only time series methodology, it is a very flexible analytical tool.

VAR is particularly useful in this study because it allows consideration of feedback effects between milk prices and product prices. That is, it is well known that product prices affect milk prices. But logically, the price processors pay for milk also affects product prices. These interrelationships are considered utilizing the VAR technique. Moreover, utilizing VAR allowed us to analyze the reality that product prices not only affect milk prices this month but the next month and, perhaps, the following month. In addition, we use VAR to simulate the impacts of a change in important variables, such as manufactured product stocks, on prices over time. The basis for these predictions is the historical regularity between prices and stocks.

VAR can be utilized either in terms of levels or changes. For example, VAR analysis of levels could relate the price of milk to the price of products. Alternatively, VAR could be utilized to analyze just the impacts of changes in the price of milk on changes in the price of products which is referred to as first difference analysis. USC utilized the first difference approach because it more directly focuses, for example, on how the price of milk might be expected to change if the price of cheese changes or if cheese stocks change. (As a check, USC did all analyses based on price levels. We found no difference in the results. Both analyses are included in Appendix D. In addition, we checked standard tests for nonstationary (Dickey-Fuller tests and augmented Dickey-Fuller tests) on levels and found each basic formula price candidate to be nonstationary in levels and stationary in first differences. These results favor using the first difference approach.) It is important to note that all stocks changes are measured in terms of total solids equivalent where the milk equivalent of milkfat is weighted by 40 percent and the milk equivalent of solids-not-fat is weighted by 60 percent.

Obviously, there is interest in the price level as well as in the impacts of price changes. As a point of reference, therefore, Table 11 presents the mean prices that were generated by each of the 10 of the 11 BFP options as compared to the M-W and the adjusted M-W series. It will be noted that the mean price levels range from $11.35 per cwt. to $12.45. These mean prices have relevance since, for example, if either A/B price series were implemented to set the level of price over time, the result would be increased production of milk, which over time would force the price back down. Alternatively, the BFP could be used as a price mover. In other words, the price of milk would change from the level at which it is implemented by the amount of change in the BFP. Our first difference analysis is of this latter type. No attempt was made to determine the mean price under the no BFP option. As indicated in Chapter 2, the price for milk used in manufacturing would be market determined and would vary regionally.

Limitations of VAR

The VAR technique is not without controversy. Economists often prefer to set up a structural model based on economic notions of how the world ought to operate. Such models generally assume that firms maximize profits and consumers maximize satisfaction. VAR makes no such assumptions. Instead, it takes the data for what it is and analyzes the relationships over time, based upon past experience.

While USC considers the VAR approach to be appropriate for this study, it can only provide a rough guide to how the BFP options would be expected to perform in the future. Simulating over a short past time period (1991-95) is not the same as asking how would the world be different if another BFP option were in place. That is, the path of prices and stocks would have been affected by the change in policy. While less likely, the stocks/price relationships could also change.

Therefore, it is important not to put too much emphasis on any individual statistic or result. Further, some of the statistical differences probably are not economically significant. However, when one BFP option performs consistently better than another, greater reliance can be placed on the results, particularly when supported by common sense reasoning.

Results of Performance Evaluation

Reflection of National Supply-Demand Conditions

As implied by the preceding discussion, the methodological considerations in measuring how well the BFP options respond to national supply-demand conditions for milk used for manufacturing are complex. USC utilized changes in the combined total of public and private sectors of manufactured product stocks (measured in total solids equivalent) as the indicator of supply and demand conditions. Stocks of butter, NDM and cheese reflect the residual of the interaction of both supply and demand forces as processors make decisions on what share of their production they can profitably sell or store for future sale. In contrast with the past, government storage has declined in importance over the period 1991-95 to the point where they are currently nonexistent (Figures 19-21). This has happened because reductions in the milk price support level have made the Commodity Credit Corporation (CCC) a relatively unattractive market compared with private sector sales or storage. We isolated the critical turning points for this change in policy as being May 1992 and November 1994. These critical turning points were accounted for in the VAR analysis by isolating the effects of stocks on the price of milk before and after these turning points.

Four statistical procedures were used to determine the extent to which the BFP options reflect supply-demand conditions as compared to the M-W and adjusted M-W series (Table 12). Each procedure measures the effect of a 248 million pound total solids milk equivalent increase or decrease in stocks on price (this number reflects on average one standard deviation shock in stocks over the study period). These measures could be applied to all of the options except pooling differentials with no BFP.

VAR could not be applied to the pooling differentials with no BFP option because we had no market determined prices to analyze in the absence of a BFP. Arguably, the price for this option could come out approximately the same as the A/B prices in the Minnesota-Wisconsin region. But in the absence of regulation, it would not be uniform. This makes analysis much more complex. Presumably, with less uniformity there would be a somewhat lower reflection of national supply-demand conditions but such a conclusion is based on common sense reasoning as opposed to empirical analysis.

Three important conclusions arise from this analysis:

Reflection of the Value of Milk for Manufacturing

When product prices change, the BFP should adjust reflecting both the magnitude of change in product prices and the share of the product's sales in the mix of manufactured products. VAR was utilized to measure the proportion of variation in the BFP for each option that is explained by the prices of cheese, butter and NDM. Sequentially, it was found that cheese prices have the largest price impact for all options, followed by butter and then NDM. Table 13 provides two related methods for measuring the extent to which the BFP options reflect values of milk for manufacturing:

USC would expect the pooling differentials with no BFP to reflect the value of milk for manufacturing on a regional basis as determined by regional product receipts and competitive conditions. As a result, the relationships to national product price levels would be less direct. Thus the expectation would be poorer performance than the competitive pay prices. However, this expectation is not based on empirical analysis.

The conclusion the USC draws is that product price formulas with a cost-based make allowance and pricing components with no basic formula price generally do the best job of reflecting product values in the price of milk. Competitive pay prices consistently rank in the lower half of the options. The feed cost snubbed product price formula performed the poorest in reflecting product values. This should not be surprising since the addition of feed costs logically would be expected to reduce the relationship of product prices to milk prices.

Stability of BFP Options

With milk prices being more unstable in the 1990s, and in the absence of a support price after 1999, greater attention might logically be given to the amount of price variation experienced by each option. Two statistical measures were utilized to measure stability (Table 14):

The pooling differentials with no BFP option would be expected to be less stable than any of the other options because government presumably provides, at least, short-run price stability and greater regional uniformity in prices. This expectation, however, is based on common sense reasoning, not empirical analysis.

USC draws the conclusion that some of the BFP options indeed are more stable than others. More sophisticated options having cost-based make allowances appear to have a particularly favorable price stabilizing effect. Perhaps this is because the option itself incorporates key values within the price that would otherwise have to be revealed in the marketplace as potentially destabilizing factors.

Conclusion

Table 15 summarizes the results of the Step 2 analysis by ranking each BFP option by each of the three criteria and their subcomponents. Table 16 boils these rankings down by weighting each of the criteria equally. While small differences in these ranks may not be meaningful from an economic perspective, this procedure and weighting suggests substantially superior performance for pricing components with no BFP, and for the butter/powder-cheese formulas that utilize a cost based make allowance. While not based on empirical analysis, USC would expect the pooling differentials with no BFP to perform more like the competitive pay price options than either the product price formulas or pricing components with no BFP.

To Chapter 4
Back to Chapter 2
Back to title page