Modern protection without signatures – comparison test on real threats

28 February 2022

We started the year 2022 with protection test of modern antivirus solutions on so-called samples in the wild that can be found in various areas of the Internet, also captured by our honeypots. This test is completely automated, so it can run continuously 24 hours a day. We used more than 1800 samples of malware for the test. We verify all viruses before they are added to our test base.

In January 2022, we checked the following applications to protect desktops:

  • Avast Free Antivirus
  • Avira Antivirus Pro
  • Comodo Advanced Endpoint Protection
  • Comodo Internet Security
  • Emsisoft Business Security
  • F-Secure Total
  • Malwarebytes Premium
  • Microsoft Defender
  • SecureAPlus Pro
  • Webroot Antivirus
 

Unlike other testing laboratories, our tests are fully transparent, so we provide a complete list of virus samples. Key information and test results are available at https://avlab.org/recent-results.

 

Summary of January edition of the test

Notice the Level 3 of analysis because it shows real protection against 0-day samples. But beware! Certain antiviruses of the next generation intentionally do not have protection in a browser (Level 1). Sometimes they do not have traditional protection based on signatures (Level 1 and Level 2), so without proper interpretation, such tests could favor other protection solutions. Not ours!

In our tests, we do not award negative or positive points for early blocking of threats. Simply put, security products must stop a threat in any way – designed by a developer. The final result is whether or not this has been achieved

January 2022 advanced in the wild malware test

The so-called Level 1 shows early blocking of threats in a browser or on a hard drive.

If this fails, the next is Level 2: a virus is scanned by the antivirus based on signatures when moving from X to Y folder. Obviously, only if such protection exists. In this test, there are many test cases when samples have not been tested by developers yet, so the next level of analysis is crucial.

Level 3 represents modern protection without any signatures. In such cases, a virus is run in the operating system. It is the most dangerous situation but needed because it shows true effectiveness of protection against and 0-day files – a threat unknown to a developer of protection software.

guest
0 Comments

Test Participation & Certification Options

Vendors can participate directly in the Advanced In-The-Wild Malware Test or obtain a Certification-Only Package for a product independently tested by AVLab. Paid participation provides access to extended technical services, test data, and custom configuration options, while result review and verification remain available to all tested vendors.

Advanced In-The-Wild Malware Test - What Is Included?

Paid Assessment Participation
Certification-Only Package

GENERAL

Advanced In-The-Wild Malware Test
Previously performed by AVLab
Public test results
Certification, if criteria are met
Annual awards, if eligible

RESULT REVIEW & TRANSPARENCY

Result review and clarification
Available to all tested vendors
Available to all tested vendors
Evidence necessary to verify a disputed result
Available to all tested vendors
Available to all tested vendors
Vendor commentary and response
Available to all tested vendors
Available to all tested vendors

TEST PREPARATION & CUSTOM CONFIGURATION

Product onboarding and configuration review
Not applicable
Vendor-recommended product configuration
Not applicable
Custom logging configuration
Not applicable
Vendor-requested technical logs
Not available retroactively

TECHNICAL SERVICES AND DATA

Detailed technical analysis
Available separately
Detailed test data
Available separately
API access to test data
Available separately
Evidence & technical logs
Available separately
Additional validation and retesting
Depending on scope
Available separately
Technical consultation with AVLab
Available separately

CERTIFICATION & MARKETING RIGHTS

Official certificate issued by AVLab
Certification badge
Use on vendor website
Use in social media and PR
Use in sales and marketing materials
Annual award materials, if eligible

Commercial use of AVLab certificates, certification badges, and award materials by independently tested vendors requires either Paid Assessment Participation or a Certification-Only Package. Independently tested vendors without either option may be listed in AVLab results and certification records but are not granted the right to use AVLab certification materials in their own marketing or communications.