The article you just read was brought to you by a few thousand dedicated readers. Will you join them?

Thanks for coming by The Tyee and reading one of many original articles we’ll post today. Our team works hard to publish in-depth stories on topics that matter on a daily basis. Our motto is: No junk. Just good journalism.

Just as we care about the quality of our reporting, we care about making our stories accessible to all who want to read them and provide a pleasant reading experience. No intrusive ads to distract you. No paywall locking you out of an article you want to read. No clickbait to trick you into reading a sensational article.

There’s a reason why our site is unique and why we don’t have to rely on those tactics — our Tyee Builders program. Tyee Builders are readers who chip in a bit of money each month (or one-time) to our editorial budget. This amazing program allows us to pay our writers fairly, keep our focus on quality over quantity of articles, and provide a pleasant reading experience for those who visit our site.

In the past year, we’ve been able to double our staff team and boost our reporting. We invest all of the revenue we receive into producing more and better journalism. We want to keep growing, but we need your support to do it.

Fewer than 1 in 100 of our average monthly readers are signed up to Tyee Builders. If we reach 1% of our readers signing up to be Tyee Builders, we could continue to grow and do even more.

If you appreciate what The Tyee publishes and want to help us do more, please sign up to be a Tyee Builder today. You pick the amount, and you can cancel any time.

Support our growing independent newsroom and join Tyee Builders today.
Canada needs more independent media. And independent media needs you.

Did you know that most news organizations in Canada are owned by just a handful of companies? And that these companies have been shutting down newsrooms and laying off reporters continually over the past few decades?

Fact-based, credible journalism is essential to our democracy. Unlike many other newsrooms across the country, The Tyee’s independent newsroom is stable and growing.

How are we able to do this? The Tyee Builder program. Tyee Builders are readers who chip into our editorial budget so that we can keep doing what we do best: fact-based, in-depth reporting on issues that matter to our readers. No paywall. No junk. Just good journalism.

Fewer than 1 in 100 of our average monthly readers are signed up to be Tyee Builders. If we reach 1% of our readers signing up to be Tyee Builders, we could continue to grow and do even more.

If you appreciate what The Tyee publishes and want to help us do more, please sign up to be a Tyee Builder today. You pick the amount, and you can cancel any time.

Support our growing independent newsroom and join Tyee Builders today.
We value: Our readers.
Our independence. Our region.
The power of real journalism.
We're reader supported.
Get our newsletter free.
Help pay for our reporting.

Problems with BC Business Council's Pro-HST Study

How can conclusions be true when based on data with such serious shortcomings?

By David Schreck 25 May 2011 |

David Schreck is a political analyst and former NDP MLA who publishes the website Strategic Thoughts, where a version of this article first appeared.

image atom
Premier Gordon Campbell and Finance Minister Colin Hansen rolling out HST tax in 2009.

As an economist who opposes the HST, I object to supporters of the HST frequently ridiculing opponents of the tax by portraying them as economic ignoramuses. A well-produced and funny 15-minute YouTube video dissects a paper released by Fight HST, the group headed by Bill Vander Zalm. The people who made B.C. history by being the first to successfully use the Recall and Initiative Act are not economists, but community activists who can see what the HST is costing families as a result of the $2 billion cost shift: businesses no longer pay PST and consumers pay tax on a much broader range of goods and services to more than make up the difference.

It is frequently claimed that most economists support value-added taxes like the HST. I don't know of any survey of economists to substantiate that claim, but I am aware that there are only a handful of economists who regularly speak out or write in favour of the tax. Two economists have attempted to quantify effects of the HST, Michael Smart for Atlantic Canada and Ontario and Jon Kesselman for B.C.*

The purpose of this column is to demonstrate that Kesselman's study is incorrect for two reasons. First, and most importantly, an analysis of the last 30 years of consumer price index (CPI) data show his results could be randomly obtained almost two thirds of the time. Second, the CPI data he used may be inadequate for the purposes for which he used it.

'Difference-in-Difference estimation'

Kesselman's paper was prepared for the Business Council of British Columbia. By email he informed me that a version of his paper, updated with the latest CPI data, will be published in the June issue of Canadian Public Policy. He argued that his analysis of the CPI: "... finds that the HST resulted in a 0.6 of one per cent increase in overall consumer prices in BC. This finding indicates that the average consumer is now paying just one additional dollar for every $165 of spending." He went on to write:

"Public skepticism on this point is widespread. Admittedly it is difficult for consumers to identify small price cuts across a vast array of goods and services -- whereas it is easy to see the HST, which is printed clearly on every sales receipt. But the different operation of the HST relative to the RST offers good reasons to expect the prices of some items to decrease post-HST. In this study I report on data that confirms that businesses have in fact passed through to consumers large amounts of their tax savings with the HST."

Kesselman's claims are based on a method known as Difference-in-Difference (DD) estimation. He looked at the increase in the consumer price index for all items excluding energy between June and July 2010. He then looked at the difference between the increase in the CPI for B.C. between July and December compared to the average increase in it for Alberta, Saskatchewan and Manitoba. From that relatively simple calculation he reported "price impacts for B.C. were 1.0 per cent in the first month and –0.5 per cent in the next five months, for a net impact of 0.6 per cent over the six-month period."

He then claimed that the 0.6 per cent represented the consumer impacts of harmonization and that low figure was consistent with forecasts that assumed full pass-through of the business tax savings. That conclusion is very strong for what amounts to an interpretation of one glorified ratio of index numbers, so I repeated Kesselman's calculations, not just for the last several months but for the last 30 years.

Unreliable calculation

The motivation for my look at the CPI since 1981 came from a study done by three economists at the Massachusetts Institute of Technology. They randomly generated placebo laws in state-level data on female wages and then used a regression to compute the DD estimate of the placebo's "effect." They found that the DD estimation resulted in an "effect" significant at the 5 per cent level for up to 45 per cent of the placebo laws.

Using the CPI data for all items excluding energy for B.C., Alberta, Saskatchewan and Manitoba, I repeated Kesselman's calculations for 30 years of data. I looked at the change between June and July 1981 and compared it to the difference between B.C. and the western province average between July and December 1981. That formula was generalized to other months so, for example, I calculated the change between January and February 1990 compared to the difference between B.C. and the western province average between February and July.

A graph of the figures that are equivalent to Kesselman's 0.6 per cent is shown here.

582px version of Kesselman-600.jpg

If a month is chosen at random, there is a chance of almost two out of three to get an estimate that our placebo change had an impact of less than 0.6 per cent (226 months produced calculations under 0.6 per cent and 126 produced calculations over 0.6 per cent).

Not only did Kesselman rely on an unreliable calculation, but he may have pushed the CPI beyond what it is designed to do. Documentation from Statistics Canada says: "Statistical reliability is inherently more difficult to assess for price indexes than for other statistical series due to the complex nature of composite price change and the statistical problems of estimating composite price change." It goes on to say: "Sampling error for the CPI price surveys is difficult to quantify because, except for rents and traveller accommodation, product and outlet samples are based on judgmental rather than probability sampling methods." The documentation concludes:

"The CPI is believed to be sufficiently accurate for most practical purposes. Accuracy is best at higher levels of geographic and product aggregation due to the larger sizes of the price samples for high levels of aggregation. As well, since errors can occur in price collection and editing or in making quality adjustments to estimate "pure price change", higher level aggregate indexes are likely to be better quality than lower level indexes because any distortions due to errors are more likely to cancel out. In general accuracy is better at the Canada level for any product index in the CPI compared to the same index at the province or city level. Also, accuracy is better at the All-items or major component levels of the CPI compared to individual product indexes. Finally, the CPI is more accurate as an indicator of change over several months or a year compared to the accuracy of the price change measured from any one month to the next."

Kesselman was correct when he observed public scepticism is widespread. I hope the argument I've made here demonstrates why the public has every right to be sceptical. I don't know if the talented UBC videographer will use this column to do a spoof of pro-HST economists, but one is warranted.

*Story updated at 11:10 a.m., May 25, 2011.  [Tyee]

Share this article

The Tyee is supported by readers like you

Join us and grow independent media in Canada

Facts matter. Get The Tyee's in-depth journalism delivered to your inbox for free.


The Barometer

What Issue Is Most Important to You This Election?

Take this week's poll