Outrageous Advertising: A Survival Guide for Investors

    by Mark Hulbert

    I am continually mystified by individuals' gullibility in the face of exaggerated investment performance claims. Investors who are nobody's fool when it comes to outrageous advertisements in other areas of their lives suddenly become naïve when confronted with equally outrageous investment performance claims. It doesn't make sense.

    For example, most of you wouldn't give the time of day to a used car salesman who told you that an old car had only been driven to church on Sundays. Yet many of you not only gave the time of day, but actually paid good money—to refer to a successful ad campaign of several years ago—to an investment newsletter that claimed that in 13 years' time it had turned $10,000 into more than $40 million.

    In order to boost your immunity to such claims, I'm devoting this column to a review of some advertising that, in my opinion, strains credulity. In the process I will identify certain warning signs that you should be on the lookout for when reading an investment ad.

    If you're convinced that your immunity to outrageous claims already is strong, and therefore you don't need any help from me, then all power to you. But remember that, at least in my experience, some of the most gullible investors are those who believe they are not.

    Let me stress that not all advertising for investment newsletters is false or misleading. Some ads are admirable in telling the truth, the whole truth, and nothing but the truth. But until and unless all ads live up to that standard, you need to be on your guard.

    Maximum Returns

    One of the most important lessons to learn concerns the highest return you can realistically expect to earn over long periods. I believe that this practical maximum is around 20% to 25% annualized, and even that is achievable by only a select few.

    An illustration of the use to which you can put this lesson comes from an e-mail I received concerning a newsletter that is not currently tracked by the Hulbert Financial Digest (HFD). It claimed to have produced an 847% annualized return over the past three years. Since the HFD has not calculated a track record for this service, I have no basis for ascertaining the veracity of this claim. But even if it were true, I nevertheless would not place high odds on this service being able to sustain this pace into the future.

    There are several different perspectives that help us appreciate why such a practical maximum exists. One is that returns much higher than 20% to 25% annualized are economically impossible over long periods. Consider how large your portfolio would grow to if it were able to achieve an 847% annualized return. Even if it began with as little as $1,000, within 10 years it would be worth more than the combined gross domestic products of all nations.

    Another perspective is provided by the highest long-term returns that have been produced historically. Take Warren Buffett, for instance, who is widely credited with being the most successful investor alive today. Since the mid-1960s, the book value of his company, Berkshire Hathaway, has grown at an annualized pace of around 23%. While that return is more than enough to turn both Buffett and his shareholders into extremely wealthy individuals, it's a far cry from the exaggerated performances that too often are advertised.

    The next time you receive an advertisement for performance as good or better than Buffett's, ask yourself how often such individuals come along and how likely it is that he or she would be selling advice to you.

    It is possible, but I wouldn't bet on it.

    This investment lesson doesn't mean that rates greater than 25% annualized are unattainable over short time periods. It simply means that those high short-term rates are unsustainable. Another way of putting this is that regression to the mean is a powerful force.

    Choosing Time Periods

    A related trick that advertisers play is to truthfully report performance that nevertheless is not current. Since even broken clocks are right twice a day, advertisers have no difficulty finding some period in which their clients looked like geniuses.

    This trick usually is a last resort, however, to be used when nothing else is available. After all, if a newsletter's long-term record is good, then its advertiser undoubtedly will point this out, including providing specific dates and performance numbers. If an advertisement doesn't provide such specificity, it is at least a warning sign to tread carefully.

    Consider an advertising brochure I received for a newsletter editor. According to the ad, the advisor "was recently rated as the #1 market timer by… the Hulbert Financial Digest." Though the brochure did not specify the recent period over which the advisor was so highly ranked, it did say that the HFD has "given him other awards covering periods of five years, which puts him in a different league from advisors who shine in the #1 slot for a single fleeting year."

    This was news to me. The advisor's system was nowhere near to being ranked in first position for recent performance. How far back must we go to find a period over which he ranked first? To the end of 1994, at which point it was in first place for performance over the trailing year. Even so, at that time his rank over longer periods was well down the list.

    The president of the company that publishes the newsletter explained that the source of the blunder was an individual who simply lifted language from an old and out-of-date advertisement. Evidently, prior to going to press, no one had bothered to determine whether the claim was still true.

    The Whole Truth

    Another trick that investment advisers often play is to create many different portfolios. This increases the odds that at least one portfolio will perform well. But that does not mean that the adviser is a good bet for future performance.

    I'm reminded of this lesson by an advertisement for a new newsletter. I had not tracked this new service, but did track several other newsletters published by the same advisor, and the picture painted by their track records is far less impressive. Needless to say, the advertisement for the new newsletter does not mention the track records of each of these other newsletters.

    The lesson to learn: Because advertisers can be counted on to put their clients' best feet forward, don't expect them to give you the full, unvarnished truth. If their clients are tracked by independent monitoring services such as the Hulbert Financial Digest, look to those services to get a fuller picture. If they are not tracked, get the advisers to answer—in writing—questions such as: What was their worst-performing account over various periods such as the last year, five years, and 10 years? How many clients left their money management in a loss position? Money managers are not required to answer such questions. But by the same token, you are not required to utilize the services of those who refuse.

    Figures Don't Lie

    Another advertising sleight-of-hand is to confuse arithmetic averages with geometric ones. The former does not take in account the effect of compounding, and thus overstates the real returns.

    To illustrate, assume that 10 years ago you invested $10,000 in a 5% savings account and that you reinvested the interest annually. Your account now would be worth $16,289, for a 10-year gain of 52.89%. If you used an arithmetic average to calculate your annual gain, you would report that you gained 5.29% per year (52.89 divided by 10) instead of the 5% you earned every year (which is the geometric average of 52.89% over 10 years).

    The difference between these two returns may seem modest in this case, but it becomes huge when focusing on the higher returns of the equity market over the past two decades.


    Another thing to be on your guard against is backtesting. Statisticians refer to the practice as data snooping or data mining. Regardless of what it is called, the track records produced by the practice are far less reliable than track records produced in real time.

    Data mining has become an increasingly prevalent practice in recent years, due to the advent of powerful personal computers and readily accessible historical databases. With thousands of investors mining these databases, more and more spurious patterns are being "discovered." That is why so many strategies with an apparently great track record seem to stop working the moment you start following them.

    My favorite example of this comes from Codexa Corp.'s CEO, David Leinweber. To illustrate the perils of data mining, several years ago he searched through all the data on a United Nations CD-ROM to find the indicator most correlated with the S&P 500. His discovery: butter production in Bangladesh.

    One of the best defenses against data mining is to test strategies over a different time frame than that used to discover its existence. A strategy might look good over the last decade, but how did it perform in previous decades, for example?

    Advertisers are quite ingenious in how they describe the backtesting done by their clients. For example, a newsletter advertisement I received a few years ago bragged about the impressive performance that emerged from the "system testing" of his client's strategy. It sounds better than "backtesting" or "data snooping," but in reality it is the same thing.

    Too Good To Be True

    You've heard it countless times, and it seems trite to repeat it once again. But it remains very good advice nonetheless: If an advertisement makes an investment strategy appear too good to be true, it probably is.

    Mark Hulbert is editor of the Hulbert Financial Digest, a newsletter that ranks the performance of investment advisory newsletters. It is published monthly and is located at 5051B Backlick Rd., Annandale, Va. 22003; 703/750-9060; www.hulbertdigest.com.

    This column appears quarterly and is copyrighted by HFD and AAII.

→ Mark Hulbert