Product Of The Year 2025 – Summary of Advanced In-The-Wild Malware Test

29 January 2025

Summary of Advanced In-The-Wild Malware Test

The purpose of this summary is to recognize the developers whose software participated in the research initiated by the AVLab Cybersecurity Foundation in 2024. The awarding of a special “Product of the Year 2025” award is an excellent opportunity to encourage individuals in IT managerial positions, heads of technology and security, who need to implement appropriate standards and procedures to ensure digital security with the best solutions.

In preparing the year-long test summary, we want to reward manufacturers in two categories. The first category is the “Product of the Year 2025” award, which recognizes products that offer robust protection of the Windows operating system from a comprehensive perspective. This award emphasizes the behavior of the user who browses the Internet, downloads, and runs unknown, potentially malicious files.

The second award is the “TOP Remediation Time 2025” certificate, which is awarded for rapid remediation of malware once it has entered the system and is running. The TOP Remediation Time award recognizes an effective and timely response to malware that encompasses the entire life cycle of the malware – from the moment the sample enters the system to the removal of malicious activity, such as restarting the operating system or restoring data through the rollback feature.

The Advanced In-The-Wild Malware Test series is one of the most rigorous and meticulous tests available, revealing the protection product’s capabilities against real-world threats that infiltrate computers through spam, instant messaging, or Web sites.

Our testing procedures involve evaluating solutions either on default settings or with additional security features enabled. If we determine that additional features should be activated or are required by the software manufacturer, we always include a note in the report after each test edition.

The following criteria will be used to determine the winners

To be considered for the Product of the Year 2025 certificate, the tested solution had to meet specific criteria:

  1. First, the solution had to participate in at least three editions of the Advanced In-The-Wild Malware Test. These tests are performed six times per year.
  2. Secondly, obtain 3x EXCELLENT certification, demonstrating a minimum of 99% protection effectiveness.


Additional TOP Remediation Time 2025 certification:

The software must neutralize all threats in at least three editions of the test and obtain a score of 100%. If the solution has been tested more than three times, we will consider the three results with the lowest average Remediation Time score.

Advanced In The Wild Malware Test 2025 01

What is the testing process? Information in a nutshell

The Advanced In-The-Wild Malware Test (see more details here) is a long-term analysis with the primary goal of verifying the effectiveness of tested solutions against malware in real time. In this test, we evaluate business versions of security products, which are often equipped with advanced EDR-XDR modules used to automatically hunt for threats along with remediation functionality for attacks. Additionally, we evaluate software versions tailored for individual users. In summary, we replicate a person’s Internet browsing behavior after installing security software on Windows. This is the most common scenario in which individuals can fall victim to social engineering and inadvertently download malware to the system.

Advanced In The Wild Malware Test process 01
Advanced In The Wild Malware Test process 02
Advanced In The Wild Malware Test process 03

Real samples of in-the-wild malware from real URLs are selected for the test, so the test is most beneficial for all recipients and manufacturers that participate in the study. At the conclusion of each edition, a comprehensive technical report is published detailing the threat detection and blocking methods used. In addition, using Windows systems in graphical mode, the test evaluates the real-world protection provided by the product, taking into account the remediation of each incident.

Award „Product of The Year 2025”

Additional TOP Remediation Time 2025 certification

A summary of the Advanced in-the-wild malware test

guest
0 Comments

Test Participation & Certification Options

Vendors can participate directly in the Advanced In-The-Wild Malware Test or obtain a Certification-Only Package for a product independently tested by AVLab. Paid participation provides access to extended technical services, test data, and custom configuration options, while result review and verification remain available to all tested vendors.

Advanced In-The-Wild Malware Test - What Is Included?

Paid Assessment Participation
Certification-Only Package

GENERAL

Advanced In-The-Wild Malware Test
Previously performed by AVLab
Public test results
Certification, if criteria are met
Annual awards, if eligible

RESULT REVIEW & TRANSPARENCY

Result review and clarification
Available to all tested vendors
Available to all tested vendors
Evidence necessary to verify a disputed result
Available to all tested vendors
Available to all tested vendors
Vendor commentary and response
Available to all tested vendors
Available to all tested vendors

TEST PREPARATION & CUSTOM CONFIGURATION

Product onboarding and configuration review
Not applicable
Vendor-recommended product configuration
Not applicable
Custom logging configuration
Not applicable
Vendor-requested technical logs
Not available retroactively

TECHNICAL SERVICES AND DATA

Detailed technical analysis
Available separately
Detailed test data
Available separately
API access to test data
Available separately
Evidence & technical logs
Available separately
Additional validation and retesting
Depending on scope
Available separately
Technical consultation with AVLab
Available separately

CERTIFICATION & MARKETING RIGHTS

Official certificate issued by AVLab
Certification badge
Use on vendor website
Use in social media and PR
Use in sales and marketing materials
Annual award materials, if eligible

Commercial use of AVLab certificates, certification badges, and award materials by independently tested vendors requires either Paid Assessment Participation or a Certification-Only Package. Independently tested vendors without either option may be listed in AVLab results and certification records but are not granted the right to use AVLab certification materials in their own marketing or communications.