Quote:
Consumer Reports backs up CNET and PC Mag
The well-regarded U.S. product-testing magazine, Consumer Reports, hit the newsstands last week with its own ratings of PC security programs. The lab's testing separately rated the antivirus, antispyware, and antispam programs available from each vendor. In addition, the magazine contracted with security experts to generate 5,500 original virus variants to test behavior-based protection. CR also monitored how quickly the companies released updated signatures in real time over a period of weeks as new threats emerged on the Net.
Zone Alarm Security Suite received Consumer Reports' Quick Picks award — the magazine's version of Editors' Choice — for "the best all-around protection." Perhaps because it's well known that security suites haven't yet mastered the latest spyware, CR also gave Quick Picks awards to Webroot Spy Sweeper and PC Tools Spyware Doctor in the antispyware category (with the free Spybot as a complement).
These ratings make sense. They dovetail with CNET and PC Magazine's latest findings, both in the rankings and the award winners. Besides PC Magazine's Editors' Choice for the Zone Alarm Security Suite, for example, Editors' Choice awards also went to Webroot and PC Tools in the magazine's latest, July 2006 reviews of antispyware apps.
To be sure, it's not unusual for magazines to differ in their ratings of computer products. For one thing, PC World's tests were conducted in April using ZASS version 6.0 and the then-current versions of competing products. The other publications' latest awards are based on the newer ZASS 6.5.
But when a category is as important as security suites, and when one magazine's rankings deviate so much with no logical basis, I look for a reason.
I found the answer in personal interviews with principals at AV-Test, Symantec, McAfee, and Zone Labs. To solicit comments, I provided AV-Test and PC World with draft copies of this story. I then participated in a telephone conference call with PC World editor-in-chief Harry McCracken, test center director Ulrike Diehlmann, and senior associate editor Narasu Rebbapragada.