Summary of the March edition of tests on virus samples from the Internet

27 April 2022

In March 2022 took place already 17th edition of the Advanced In The Wild Malware Test in which we regularly verify software to protect devices. To check the effectiveness of detection and blocking malicious software we use so-called samples in the wild that can be found in many areas of the Internet a casual user may come across. In addition, to increase the number of samples in the test base, we need to capture them in greater numbers that is why honeypots are necessary.

Cycle of the Advanced In The Wild Malware Test is automated process, so it can run continuously 24 hours a day. In March we acquired 2050 unique malware samples. We verify all viruses before they are added to the test base, and in disputed cases, we discuss logs with developers.

In March 2022, we checked the following applications to protect desktops:

  • Avast Free Antivirus
  • Avira Antivirus Pro
  • Comodo Advanced Endpoint Protection (for business)
  • Comodo Internet Security
  • Emsisoft Business Security (for business)
  • F-Secure Total
  • Malwarebytes Premium
  • Microsoft Defender
  • SecureAPlus Pro
  • Webroot Antivirus
 

Unlike other testing laboratories, our tests are fully transparent, so we provide a complete list of virus samples and other technical details described in our methodology. Key information and test results are available at https://avlab.org/recent-results.

Summary of March edition of the test

Notice the Level 3 of analysis because it shows protection against 0-day samples. But remember! Certain antiviruses of the next generation intentionally do not have protection in a browser (Level 1). Sometimes they do not have traditional protection based on signatures (Level 1 and Level 2), so without proper interpretation, such tests could favor other protection solutions. Not ours!

In the tests, we do not award negative or positive points for early blocking of threats. Security product must stop a threat in any way – provided by a developer. The final result is whether or not this has been achieved.

Recent Results - Advanced In The Wild Malware Test

The so-called Level 1 shows early blocking of threats in a browser or on a hard drive.

If this fails, the next is Level 2: a virus is scanned by the antivirus based on signatures when moving from X to Y folder (obviously if such protection exists). In this study, there are many test cases when samples have not been verified by developers yet, so the next level of analysis is crucial.

Level 3 represents modern protection without any local signatures because a virus is run in the operating system. It is the most dangerous situation but needed because it shows true effectiveness of protection against 0-day threats.

Starting with May edition of the test, our methodology will be slightly changed in the layer of Windows. We will inform about the details in a few weeks.

guest
0 Comments

Test Participation & Certification Options

Vendors can participate directly in the Advanced In-The-Wild Malware Test or obtain a Certification-Only Package for a product independently tested by AVLab. Paid participation provides access to extended technical services, test data, and custom configuration options, while result review and verification remain available to all tested vendors.

Advanced In-The-Wild Malware Test - What Is Included?

Paid Assessment Participation
Certification-Only Package

GENERAL

Advanced In-The-Wild Malware Test
Previously performed by AVLab
Public test results
Certification, if criteria are met
Annual awards, if eligible

RESULT REVIEW & TRANSPARENCY

Result review and clarification
Available to all tested vendors
Available to all tested vendors
Evidence necessary to verify a disputed result
Available to all tested vendors
Available to all tested vendors
Vendor commentary and response
Available to all tested vendors
Available to all tested vendors

TEST PREPARATION & CUSTOM CONFIGURATION

Product onboarding and configuration review
Not applicable
Vendor-recommended product configuration
Not applicable
Custom logging configuration
Not applicable
Vendor-requested technical logs
Not available retroactively

TECHNICAL SERVICES AND DATA

Detailed technical analysis
Available separately
Detailed test data
Available separately
API access to test data
Available separately
Evidence & technical logs
Available separately
Additional validation and retesting
Depending on scope
Available separately
Technical consultation with AVLab
Available separately

CERTIFICATION & MARKETING RIGHTS

Official certificate issued by AVLab
Certification badge
Use on vendor website
Use in social media and PR
Use in sales and marketing materials
Annual award materials, if eligible

Commercial use of AVLab certificates, certification badges, and award materials by independently tested vendors requires either Paid Assessment Participation or a Certification-Only Package. Independently tested vendors without either option may be listed in AVLab results and certification records but are not granted the right to use AVLab certification materials in their own marketing or communications.