DEV Community: wetest

Pixelworks Collaborates with PerfDog Platform to Deliver Multi-Dimensional Testing of Mobile Gaming Performance

wetest — Mon, 21 Apr 2025 08:31:26 +0000

Newly Introduced Frame Generation Visualization Benchmark Boosts Gaming Optimization

Shanghai, China-April 21, 2025 – Pixelworks, Inc. (NASDAQ: PXLW), a leading provider of visual processing solutions, today announced its strategic collaboration with PerfDog, the performance testing tool of Tencent WeTest Quality Open Platform. Recent cooperation between the two parties included the joint development and groundbreaking introduction of the "Frame Generation" index, a multi-dimensional data framework for gaming performance evaluation. This new benchmarking index stands to redefine mobile game testing standards in the AI era. Coupled with its integration into the industry debut of PerfDog 11.1, the Frame Generation index seamlessly provides developers with richer and more precise testing data on smartphones equipped with Pixelworks' hardware rendering accelerators.

Recognized for its excellent performance analysis capabilities across all platforms, including both Android and iOS, PerfDog continuously enhances App and gaming performance throughout the product optimization process. As part of the upgrade to its latest 11.1 version, the PerfDog technical team collaborated with Pixelworks to develop the Frame Generation. Leveraging Pixelworks' rendering acceleration solution and AI capabilities, the Frame Generation compensates for frequently unavailable performance testing data while delivering professional guidance for gaming performance optimization.

In the current era of rapid development of mobile games, high frame rates have become pivotal for both developers and players. Smartphone manufacturers also seek to enhance the end user experience by increasing the frame rate of mobile games utilizing various approaches, the most effective of which is by incorporating a dedicated hardware rendering accelerator. However, due to technical challenges associated with accurately and consistently measuring game performance with rendering acceleration activated, traditional mobile game performance testing is typically conducted based purely on the average frame rate and frame stability of a game. As a result, a majority of today’s existing testing standards prevent the industry from benefiting from a more precise and complete optimization of mobile gaming performance.

To address this industry challenge, Pixelworks and PerfDog closely focused on the developer requirements and collaborated to introduce the industry’s first hardware-accelerated frame rate evaluation standard. As a result, PerfDog 11.1 enables real-time visualization of post-acceleration frame rate data generated utilizing Pixelworks' rendering solutions. For developers and OEMs, these insights streamline standard performance optimization by precisely identifying rendering bottlenecks. For game players and reviewers, this new index reliably measures and demonstrates system stability and visual smoothness, enabling intuitive performance assessment.

"Since inception, PerfDog has remained committed to advancing testing technologies for developers across industries." said Wensheng Cao, founder of Tencent WeTest PerfDog. "In today's world of rapid technology development, our collaboration with Pixelworks represents a convergence of technical excellence and AI-powered innovation. This cross-domain partnership not only establishes a new industry benchmark for performance but also paves the way for future data dimension expansion in our product ecosystem."

（Wensheng Cao, founder of Tencent WeTest PerfDog）

Commenting on the joint development, Jun Fang, Vice President of Pixelworks and General Manager of Mobile Business Unit, stated, "We were thrilled to collaborate with PerfDog in exploring new gaming performance frontiers. Leveraging our more than two decades of visual processing expertise and early AI technology implementation across mobile and gaming scenarios, Pixelworks was proud to contribute to the joint development of the industry’s first Frame Generation index. This cooperation with PerfDog opens expanded opportunities for further gaming quality enhancements, and activates deeper data utilization to propel industry-wide performance ecosystems forward."

About PerfDog
PerfDog is a comprehensive performance testing and analysis tool that caters to various platforms, aiding developers and QA engineers in monitoring, analyzing, and optimizing application performance. With capabilities for real-time data monitoring, in-depth performance diagnostics, and network performance assessments, it supports automated processes and simplifies team collaboration, making the software development and quality assurance process more efficient and systematic. Thanks to its robust features and user-friendly interface, PerfDog is an essential tool for enhancing software performance. Website of PerfDog perfdog.wetest.net

About Pixelworks
Pixelworks provides industry-leading content creation, video delivery and display processing solutions and technology that enable highly authentic viewing experiences with superior visual quality, across all screens – from cinema to smartphone and beyond. The Company has more than 20 years of history delivering image processing innovation to leading providers of consumer electronics, professional displays and video streaming services.
For more information, please visit the company’s website at www.pixelworks.com.

Note: Pixelworks and the Pixelworks logo are trademarks of Pixelworks, Inc. All other trademarks are the property of their respective owners.

WeTest showed PC & Console Game QA services and PerfDog at Gamescom 2024

wetest — Tue, 03 Sep 2024 03:17:15 +0000

At the Gamescom gaming expo held in Cologne, Germany, from August 21 to 25, 2024, Tencent's WeTest showcased its PC & console game quality assurance services and cross-platform performance testing and analysis tool, PerfDog, to global gaming clients.

As an integrated quality cloud platform, WeTest has over a decade of quality management experience, committed to establishing global quality standards and improving product quality. WeTest is a member of the IEEE-approved global game quality assurance working group and has provided quality assurance services to over 10,000 enterprise clients in more than 140 countries.

WeTest focuses on developing advanced testing tools. By integrating the latest AI technologies, it has launched several professional game testing tools, including PerfDog, CrashSight, and UDT (the next-generation multi-terminal unified access management automation testing platform). These tools help over millions of developers worldwide improve development efficiency. WeTest also provides comprehensive testing service solutions covering the entire lifecycle of mobile, PC, and console games. The services include compatibility testing, security testing, client performance testing, functional testing, localization testing, compliance testing, regional testing, and various other services, ensuring product quality for over 1,000 game companies globally.

At Gamescom, WeTest highlighted its comprehensive capabilities in PC and console game quality assurance. In terms of functional testing, WeTest supports full-scenario coverage, including core game features, third-party components, payment, updates, audio, weak network testing, etc., ensuring a seamless gaming experience. Compatibility testing offers more than 10 dimensions of compatibility testing items, covering 80% of Steam user devices at the device level, helping developers anticipate and resolve potential compatibility issues across different devices and operating systems.

Regarding performance testing, WeTest utilizes its self-developed performance tools to evaluate game performance under various hardware configurations, including loading times, frame rates, and memory usage, helping developers analyze and optimize game performance to deliver the best gaming experience. Compliance testing covers requirements for multiple platforms, such as Xbox One, Nintendo Switch, and PlayStation, with nearly 500 rule checkpoints, helping enterprises proactively mitigate risks and improve approval pass rates.

WeTest's self-developed X-automator automated testing interacts with the game engine layer through plugins embedded in the game. It enables complete testing scenarios through scripting, automatically reports comprehensive test data, and supports various scenarios such as regular smoke testing, multi-machine coordination, and customization, offering higher flexibility, accuracy, and support for complex scenarios.

Moreover, WeTest has established industry PC hardware benchmarks and game genre benchmarks, providing developers with free and easily accessible up-to-date industry information. This helps developers understand PC player device dynamics, formulate optimal quality assurance strategies and technology selections, and comprehensively understand the market distribution and performance profiles of competitors.

As one of WeTest's core products, PerfDog is a cross-platform performance testing and analysis tool designed to provide comprehensive performance analysis solutions for various devices and operating systems, including Android, iOS, PC, and consoles. PerfDog has served millions of professional users, with over 20 million total tests conducted. It is widely adopted by global chip companies and favored by major mobile phone brands worldwide. Additionally, PerfDog provides performance testing services to hundreds of game companies, such as Tencent, Supercell, NCSoft, Riot, Garena, and Netmarble, demonstrating its exceptional value and extensive application in the performance testing field.

PerfDog is the first in the industry to support iOS 17 system testing, offering cross-platform multi-device support, comprehensive professional performance metrics, real-time data monitoring and diagnosis, automated testing, and cloud services as core features. It can be conveniently used without rooting or jailbreaking and has the advantages of high data accuracy and low performance impact.

With the successful conclusion of this year's Gamescom, WeTest looks forward to deeper cooperation with more game developers worldwide, providing strong quality assurance and performance optimization support for creating high-quality games. WeTest will continue to invest in research and development, constantly improving game quality assurance services and performance testing solutions to support innovation and development in the global gaming industry.

About WeTest

WeTest, with over a decade of experience in quality management, is an integrated quality cloud platform dedicated to establishing global quality standards and enhancing product quality. As a member of the IEEE, approved Global Game Quality Assurance Working Group, it is recognized for its commitment to quality assurance. WeTest has served over 10,000 enterprise clients across 140+ countries.

Focusing on advanced testing tools development, WeTest integrates AI technology to launch professional game testing tools such as PerfDog, CrashSight, and UDT (Next-Gen Multi-Terminal Unified Access Management Automated Testing Platform), aiding over a million developers worldwide in boosting efficiency. Additionally, WeTest offers comprehensive testing service solutions for mobile, PC, and console games, covering compatibility, security, functionality, localization testing and other various services, ensuring product quality for over one thousand game companies globally.

Give it a try for free today. Register Now!

Try Out WeTest UDT: The Ultimate Cloud Testing Solution for Developers

wetest — Fri, 16 Aug 2024 03:53:12 +0000

In today's fast-paced digital world, having a reliable and efficient cloud testing solution is crucial for developers. WeTest UDT (Unified Device Toolkit) is a one-stop cloud testing solution that provides the ultimate, efficient, and stable cloud testing experience. In this blog, we will explore the advantages, key functions, use cases, and product solutions of WeTest UDT.

What is WeTest UDT?

UDT is a comprehensive cloud testing platform that integrates one-click device access and management, real device testing, scripting, automated testing, and resource management. It helps enterprises quickly build private testing platforms, improve testing efficiency, and optimize device resource utilization.

Key Advantages of WeTest UDT

Efficient sharing of local devices and expandable access to multiple types of devices: UDT enables one-click device access and sharing, supports access to various devices like local and cloud mobile phones, cars, and smart hardware, and offers flexible device management for improved resource utilization.

Ultimate Smooth SaaS Experience: UDT provides ultra HD image quality, smooth debugging experience, and rich debugging tools. It also supports stable and efficient execution of automation testing with frameworks like GA, WA, and AirTest.

Quickly build a private platform or enhance existing abilities: UDT offers private deployment options to meet confidentiality and local requirements, independent site deployment, and complete isolation of business data for a low-latency real user experience.
Write scripts and build mobile automation testing systems quickly: UDT supports various automated testing frameworks, image and OCR recognition, device operation management, and accurate identification of in-game objects.

WeTest UDT Product Solutions

Real Device Testing
UDT offers low latency (30 to 150ms), ultra-clear picture quality (30 to 60Fps), and low resource usage (CPU usage of the front-end is less than 1%). It supports multiple device types and access methods, as well as multi-system access for Android and iOS devices. This allows developers and testers to work with real devices, simulators, and other specialized hardware like car devices, ensuring comprehensive testing across various platforms.

Multiple Device Types: Supports access to smartphones (Android/iOS), tablets, simulators, car devices, and more.
Multiple Access Methods: Supports private cloud devices, local devices, and third-party Device Farm's cloud devices.
Multi-System Access: Allows access to any Android and iOS device using any system, such as Windows, Linux, or Mac.

Debugging Tools
UDT provides a full range of debugging tools to facilitate problem locating, saving more than 30 minutes on a single bug positioning.

Shortcut Bar Tool: Volume adjustment, quick input box window, and debugging details toolbar.
Application Management: Supports large application uploading and installation, and collects Android/iOS logs.
WDB Remote Debugging Tool: Directly connects to Android and iOS devices for remote debugging.
Terminal Tool: Exclusive terminal tool available for direct operation on the web.
Visual File Manager Tool: Supports file and folder upload/download for easy file transfer.

Visual File Manager
The industry's first Android/iOS visual file manager provides 80% more efficient device file operation.

Creating new folders/files
Downloading files with optional file types
Uploading folders/files from local
Searching files
Switching display mode
Viewing document details
Multi-selection file support

Android & iOS WDB Remote Debugging Tool
This tool can be directly downloaded to local and connect Android and iOS devices simultaneously. Features include:

Suitable for Mac/Windows/Linux systems
Connecting multiple remote devices
Simultaneous connection of Android and iOS devices
Exclusive support for iOS device debugging
High stability of the device connected to ensure effective execution of remote debugging

Automated Testing
UDT provides stable and efficient execution of automated tests, allowing users to run compatibility, functional, and performance testing according to different scenarios. It also supports uploading scripts from local files or importing scripts from Git repositories, making it easy to integrate existing test scripts and frameworks. UDT's automated testing solution helps save time and resources, as well as improve overall testing quality and reliability.

Support for Mainstream Testing Frameworks: UDT supports more than 10+ mainstream testing frameworks such as Appium, Python, GAutomator, AirTest, and WeAutomator. Users can upload scripts from local files or import scripts from git repositories, eliminating reliance on self-recording tools to generate scripts.
Script Running in K8s/Docker: Automation test scripts are executed in containers, which support a variety of frameworks, resource isolation, and provide efficient and secure testing environments.
Flexible Test Initiation: UDT supports RestFul API, WebUI, and CI/CD Plugin, allowing tests to be integrated into CI/CD pipelines to expand capabilities. It also implements task management distribution component taskd based on Docker container virtualization isolation technology to quickly build an automated environment.
Personalized Task Configuration: UDT allows for task configuration, including application selection, resource configuration, and test configuration. Users can select any test case in the case library to execute the test. It supports serial/parallel distribution of use cases and various timeout parameters, such as setting the execution timeout of overall task, individual devices, and individual use case.
Detailed Reports: UDT provides detailed reports from the device and use case dimension. It provides statistics of test cases on each device, statistics of device of each test case, and basic test results, device activity information, videos, screenshots, app performance data, and test files.

Scripting Tool - WA for VSCode
UDT integrates the automated testing system into the VSCode R&D workflow, improving the efficiency of script editing and lowering the scripting threshold. The lightweight VSCode plugin offers code completion, code tracing, and breakpoint debugging features for Android, iOS, Unity, and Unreal control recognition. This integration enables developers to write, edit, and debug test scripts seamlessly within their preferred development environment.

Lightweight Form: Offers a 30-second download launch based on hardware decoding technology.
Minimal System Impact: The plugin process memory occupation is just 15MB, and CPU occupation is less than 5%.
Rich Code Templates: Provides a variety of code templates with one-click generation and supports code tracking, code completion, and breakpoint debugging.
Flexible Catalog Arrangement: Offers a complete project directory display and a flexible structure.
Low-Cost Environment Management: Supports flexible switching between multiple languages and integrates multiple R&D tools.
Control Tree One-Click Dump: Supports the current device screenshot and control tree exporting, compatible with UI Automator viewer.
Built-in Smart Monkey Feature: Allows for the one-click generation of intelligent monkey scripts.

Device Access and Management
WeTest UDT provides a low-cost, flexible, and high-stability solution for device access and management. It supports both local devices and private cloud devices, offering a range of features to enhance device utilization and testing efficiency.

Local Device Access: UDT enhances the utilization rate of scattered devices by allowing local devices to be accessed at any time. Users can easily add their devices to UDT using the UDT Desktop with just one click.
Private Cloud Device Access: WeTest offers data center grade device deployment (SLA: 99.9+) for devices on the private cloud. This includes network dedicated line access for high stability, and a variety of device types through self-developed Android customizer and emulator solutions.

Private Device Cloud

UDT offers a fully customizable app-testing infrastructure with dedicated devices in a dedicated environment. Key features include:

24/7 Availability: The private device cloud is available 24/7 with unlimited access, usage, and users. Users do not have to share devices with others, lowering device management and infrastructure maintenance costs.
Maximum Device Coverage: Users have the flexibility to choose dedicated devices including iPhone, Huawei, Xiaomi, Samsung Galaxy, Pixel with different screen sizes, and OS versions.
Custom Testing Environments and Device Configuration: UDT supports custom testing environments using containers. Users can configure device cleanup procedures, reset device connections, monitor the performance of their environment, and more.
Enterprise-Grade Security: The real devices and network infrastructure are hosted and maintained by the WeTest team in highly secured data centers. The service is encrypted, and all uploaded content and test results are visible only to private cloud users. This ensures the highest level of security for your testing data.

Testing Scenarios

WeTest UDT supports the following testing scenarios:

UI functional testing and regression testing: UDT helps companies test their applications for UI functionality and identify potential regressions during the development process.
OOM, memory leaks, and other problem positioning: UDT's debugging tools and automated testing capabilities make it easier for developers to find and fix memory leaks and other performance issues in their applications.
Compatibility testing: UDT enables companies to quickly find and locate compatibility issues like crashes, ANRs, and installation failures on different devices and operating systems.
Online user feedback anomaly positioning and investigation: UDT's real device testing and automated testing features help companies investigate and address issues reported by users.
AppStore and other distribution channels and payment channel testing: UDT supports testing for various distribution channels and payment systems, ensuring seamless user experiences across different platforms.

Customer Cases - How UDT Enhances Your Global Collaboration and Business Development

Pain Point
As businesses expand globally, they face challenges in managing and testing their devices across different regions. This includes difficulties in accessing local devices, integrating new devices, and debugging issues. Additionally, there is a need for efficient file management and automation testing capabilities to improve overall testing efficiency.

Solution
WeTest UDT addressed these challenges by providing the following solutions:

Access to hundreds of local devices in multiple regions: WeTest UDT supports clients in Europe, Asia, and America by providing access to hundreds of local devices across multiple nodes. This enables clients to conduct tests on a wide range of devices, ensuring compatibility and performance across different markets.
Assistance with iOS 17 device integration and debugging: WeTest UDT helps clients integrate and debug iOS 17 devices by expanding the "1 main station + N forwarding" architecture. This avoids the need for cloud-based virtual machines to bypass the main station, improving the smoothness of overseas local usage. We also address the technical challenges associated with the iOS 17 protocol, helping clients overcome testing difficulties with new iOS versions.
Convenient cloud-based debugging capabilities: WeTest UDT offers an exclusive Android/iOS visual file manager, allowing users to conveniently download and manage files on their devices. We also optimize overseas file transfer nodes, providing clients with a wealth of debugging tools and improving device file operation efficiency by 80%.
Flexible automation testing capabilities: WeTest UDT provides users with pytest, custom frameworks, and custom test parameter capabilities. This enables clients to quickly conduct automated and stability tests on multiple versions of their devices overseas, improving automation testing efficiency by 100%.
Global collaboration and device sharing: WeTest UDT allows clients to share and manage devices across their teams, enabling quick problem identification and debugging. This promotes global collaboration and ensures that issues can be resolved efficiently.

Results
By offering these solutions, WeTest UDT has successfully supported clients in their global expansion efforts, providing them with the tools and resources needed to manage and test their devices effectively. Clients have experienced significant improvements in testing efficiency, device file operation efficiency, and automation testing capabilities, ultimately enhancing their global collaboration and business development efforts.

Despite this specific user case, WeTest UDT has been successfully implemented by a variety of companies in different industries. Another example is providing Tencent Game Support. UDT helps Tencent overcome challenges like multi-regional teams, low-efficiency remote debugging, device duplication purchases, and high demand for data privacy. It enables efficient sharing of devices in the cloud, allowing teams to collaborate effectively and improve testing efficiency.

Read the original blog →: Here

About WeTest

WeTest, with over a decade of experience in quality management, is an integrated quality cloud platform dedicated to establishing global quality standards and enhancing product quality. As a member of the IEEE-approved Global Game Quality Assurance Working Group, it is recognized for its commitment to quality assurance. WeTest has served over 10,000 enterprise clients across 140+ countries.

Focusing on advanced testing tools development, WeTest integrates AI technology to launch professional game testing tools such as PerfDog, CrashSight, and UDT, aiding over a million developers worldwide in boosting efficiency. Additionally, WeTest offers comprehensive testing service solutions for mobile, PC, and console games, covering compatibility, security, functionality, localization testing and other various services, ensuring product quality for over 1,000 game companies globally.

Give it a try for free today. Register Now

Developers, Meet Us @ Gamescom 2024 to Uncover PerfDog and Other Top QA Testing Tools!

wetest — Mon, 12 Aug 2024 07:42:20 +0000

✨ Hey Dev Community! ✨

We are excited to announce that WeTest Global will be participating in the highly anticipated Gamescom 2024. As one of the largest gaming events in the world, Gamescom is the ultimate hub for game developers, industry professionals, and enthusiasts alike.

We sincerely invite you to drop by our booth and explore our innovative game testing tools and solutions 👇

Why Visit Us?

As a leading name in the industry, we specialize in providing comprehensive software and game testing solutions. Our tools are designed to optimize your game's performance throughout the development cycle, ensuring a seamless and satisfying player experience.

Moreover, this year our senior product manager will deliver a special speech about our star Performance Testing tool PerfDog as well as other industry-leading testing solutions. It's a fantastic opportunity to meet with our team, ask questions, and get a firsthand look at how our solutions can benefit your gaming apps.

By visiting our booth, you will:

Discover WeTest advanced testing tools and solutions
Learn how to optimize your game app's performance
Understand more about game testing
Engage in insightful discussions with our team of experts

What is Gamescom 🎮

Gamescom is not just a gaming event, but a platform for the whole game community to connect and collaborate. This global event brings together the most innovative minds in the gaming industry, showcasing the latest trends and breakthroughs.

Mark Your Calendar!

Event: Gamescom 2024
Date: 21-25 August 2024
Location:Cologne, Germany
Booth: No B-063|Hall 04.2

Our Booth Location 👇

Gamescom Timetable 👇

Don't miss out on this opportunity to enhance your game development process with our state-of-the-art testing solutions. We look forward to connecting with you at Gamescom 2024!

📅 Book a meeting now →: Meet with WeTest Experts

About WeTest

Give it a try for free today. Register Now

Compatibility Testing for PC Games: A Full Guide

wetest — Fri, 02 Aug 2024 10:42:33 +0000

What is Compatibility Testing of PC Games?

Compatibility testing, at its core, is a type of non-functional testing conducted to ensure that your apps or games are capable of running on different environments. This includes but is not limited to different hardware configurations & operating systems, different types of screen monitors, as well as various software applications, different network environments, different terminals, different languages, and so on.

When it comes to the compatibility testing of PC games, its scope usually narrows down to the following 3 types:

Hardware Compatibility: This involves testing the game on different hardware configurations. It includes different types of processors (CPU), graphics processing units (GPU), memory (RAM), hard disk capacities, and screen resolutions. The objective is to ensure that your game performs optimally across all these different setups.
Software Compatibility: This involves testing your game over different operating systems (like Windows 7, Windows 8, Windows 10, Windows 11, etc.), and antivirus software, input methods, and DirectX versions. The goal is to guarantee that your game runs smoothly, regardless of the software environment.
Language Compatibility: Apart from English, your game may have players from different regions who speak Chinese, Japanese, French, Spanish, and other different languages. Testing your game in various languages ensures that all text in the game is correctly displayed and understandable to players, regardless of their language.

Note: For games that run on other devices or platforms, they also need to do console devices, or other kinds of compatibility testing. For example, players nowadays expect games to be released on their preferred platforms. It's not uncommon to see players criticize a game on social media if it fails to launch on their devices during a global release. As a result, developers need to ensure that their game is compatible not only with PCs, but also with devices like PlayStation, Xbox, and Switch.

And, if your game runs on a browser, you will need to test it across different browsers (like Chrome, Firefox, Safari, etc.) and even different browser versions.

Why Compatibility Testing of PC Games?

Good compatibility testing helps you REACH MORE USERS.

For developers, it's essential to ensure that your PC games can have a good performance on all popular terminals. Bad compatibility will cause direct harm to user experience and potential loss of players.

That's why it's crucial to conduct compatibility tests on various PC devices. By doing so, you can identify issues and bugs early on and fix them promptly. At the end of the day, it leads to heightened customer satisfaction, broader market penetration, and an expanded user base.

However, it could be highly challenging if you choose to do it within your own team:

Unable to guarantee full coverage: with so many and diverse device brands, OS versions, and PC screens on the market, it‘s challenging to guarantee that the game product is compatible with most PC devices.
Lack of professional QA testers: this slows down the testing process, results in uncomprehensive compatibility testing, and hinders the launch of your product.
High costs to get expert testers: Hiring a seasoned tester can be very expensive! Balancing the cost of expert testers with the need for thorough testing might give you a headache.
High costs in equipment purchase, updates & maintenance: Ensuring compatibility requires a substantial investment in acquiring various devices, keeping them up-to-date, and maintaining them in optimal condition. This can drain your resources and budget.

How to do it efficiently?

With a decade of experience in game testing, in our team, we can do PC game compatibility testing covering mainstream PC devices, which help us discover bugs and problems to ensure a smooth gaming experience for players.

Testing Solution
We test core scenarios of games, including download, installation, launch, core operations, and uninstallation, etc. Our testing focuses on hardware (CPU, GPU, screens) and software (OS, antivirus, input methods, DX) compatibility issues.

PC Benchmark
To help customers optimize device configuration, we have crafted a PC benchmark functions based on the latest market data.

1. Main Functions

Comprehensively analyze PC gaming device trends across 6 critical dimensions
Capture multidimensional device information from 3 key lists: TOP → GPU, Latest Released GPU, and Recent Hot GPU
Data is updated monthly to ensure timely insights into the latest trends in PC gaming devices.

2. Scenarios

Select and configure testing devices for compatibility testing. Formulate a selection strategy in terms of specific testing objectives, leveraging the authoritative data to devise the optimal strategy.
Acquire knowledge of the screen resolutions to refine game visualization performance and compatibility.
Game enterprises can precisely assess common device configurations and operating systems, facilitating to make tailored corporation positions and marketing strategies to expand their user base.

You can learn it here →: PC Specification Benchmark

Key Points for PC Games Compatibility Testing

Comprehensive scenario coverage: It needs to cover whole-life gaming scenarios, including but not limited to: installation, launch, login, character creation, tutorials, store, events, combat, and uninstallation, etc.
Covers mainstream devices: Needs to have various devices available to guarantee needs of most players. For reference, we conduct compatibility testing across 10+ dimensions, covering 80% of GPUs used by Steam users, mainstream CPUs including Intel and AMD.

We actually have a list for our supported PCs →：here

Quickly detect compatibility issues：Long testing time can drain your resources and budget! Need to make the process simple and quick.

Efficient delivery of professional report：Need to customize software and hardware compatibility solutions tailored to Clients, and efficient delivery. Every game has different bugs and issues.

Read the original blog →: Here

About WeTest

Give it a try for free today. Register Now!

How to Build Successful Payment Systems

wetest — Tue, 30 Jul 2024 06:53:38 +0000

As a software testing engineer, I can't stress enough the importance of local payment testing. It's a crucial part of the development and maintenance of any payment system, ensuring its accuracy, security, and reliability. In this article, I'll discuss the key issues that can occur during payment testing and why it is essential.

Are Your Payment Systems Robust Enough?

Local payment testing is not just about checking if a transaction goes through. It's about ensuring that the entire payment process, from selecting a payment method to the final confirmation of payment by users, works seamlessly. It's about making sure that the payment systems are robust enough to handle real-world scenarios, including sudden surges in traffic or transactions in different currencies.

Local payment testing helps businesses understand and navigate the complex landscape of local regulations, currencies, payment preferences and more. This ensures that your payment systems are not only technically sound but also cater to the local market's needs and expectations.

Common Payment Problems We May Encounter

Throughout my experiences in payment testing, I've encountered a range of issues. Some of the most common ones include:

Regional Restrictions: These can range from needing a local tax identification number or a local bank account to make payments. For instance, in Brazil, it's impossible to test payments without a local account and payment card.
Platform Limitations: Some platforms may impose restrictions on payment testing, such as requiring a local account or payment card for testing. For example, Google locks payment testing to specific regions.
Risk Control Measures: Payment systems often have built-in risk control measures that can cause payment failures or limitations. Thorough testing is needed to identify these issues and adjust the system accordingly. For instance, in one test case, we found out that payments exceeding a certain amount were restricted by banks and telecom companies of that country.
UI Errors and Pricing Discrepancies: Wrong price, unable to get paid items, repeated payments, wrong UI displays and more can lead to customer confusion and dissatisfaction, and ultimately, loss of business. It's crucial to ensure that the pricing information is accurate and the user interface is intuitive and user-friendly. One example is that during the payment testing of a video game, we found a UI error where the price decimal point of a weapon appearance was marked incorrectly.

Why Choose Us?

At WeTest, we understand the complexities and challenges of local payment testing.

Our payment testing services

Payment Channel Testing: We test various payment channels to ensure that they function correctly and efficiently in the local context.
Payment Tier Testing: We test different payment tiers to ensure that they are correctly configured and provide the expected outcomes.
Continuous Payment Testing: We conduct tests involving continuous payments to identify any potential issues that might arise from repeated transactions, such as triggering risk control measures.

Our Key Advantages

Whole life-cycle support: We can support payment testing covering the whole life-cycle of software development, prelaunch, launch and operation. For instance, after a product is launched, when there are changes in the payment configuration, we conduct real-money payment testing for core regions to avoid common payment issues such as different prices in different regions/platforms, payment failure, and triggering local risk control.

Covering mainstream payment channels: We offer comprehensive payment testing services for a wide range of mainstream payment methods, including but not limited to Apple Pay, Google Pay, Samsung Pay, PayPal, Credit Card, Bank Card, UnionPay, WeChat Pay, and Alipay.

Real-life payment scenarios: Our team of expert testers conducts rigorous testing using real networks, devices, and payment methods from around the globe. This approach allows us to replicate real-world scenarios and provide you with accurate and reliable testing results.

We prioritize confidentiality and security throughout the testing process. Our testers undergo specialized training and adhere to strict confidentiality protocols to safeguard test-related information.

To wrap up, local payment testing is an essential part of ensuring a seamless and secure payment experience for your customers. With WeTest, you're choosing a partner dedicated to delivering exceptional service, genuine and accurate results, and the expertise to navigate the complexities of local payment testing.

About WeTest

WeTest, with over a decade of experience in quality management, is an integrated quality cloud platform dedicated to establishing global quality standards and enhancing product quality. As a member of the IEEE-approved Global Game Quality Assurance Working Group, it is recognized for its commitment to quality assurance. WeTest has served over 10,000 enterprise clients across 140+ countries.

Focusing on advanced testing tools development, WeTest integrates AI technology to launch professional game testing tools such as PerfDog, CrashSight, and UDT (Next-Gen Multi-Terminal Unified Access Management Automated Testing Platform), aiding over a million developers worldwide in boosting efficiency. Additionally, WeTest offers comprehensive testing service solutions for mobile, PC, and console games, covering compatibility, security, functionality, localization testing and other various services, ensuring product quality for over 1,000 game companies globally.

Give it a try for free today. Register now!

Understanding Test Cases and Their Importance in Software Testing

wetest — Fri, 26 Jul 2024 02:41:26 +0000

Test cases, in essence, comprise a series of test steps that portray the specific actions to be undertaken by the user for executing the test. These steps serve as a roadmap for testers to follow in order to conduct the test effectively. Test cases encompass elements such as the test scenario, input data, expected outcomes, and any prerequisites necessary for successful test execution. By adhering to these meticulously crafted test cases, software testers can systematically evaluate the functionality and behavior of the software being tested, ensuring its quality and reliability.

The Definition of Test Case

A test case is a set of variables or conditions that a tester uses to evaluate whether an application, system, or specific feature adheres to the requirements specified in its specification.

A test case is considered inadequate if it lacks expected results, execution environment information, preconditions, or input data. In such cases, executing the test case may not yield valuable insights and may not be meaningful.

Before offering software quality assurance testing services, testers undergo extensive training and gain substantial knowledge and experience in the field of software testing. This ensures their proficiency in performing testing activities effectively and delivering reliable results.

High-level Test Case

A high-level test case refers to a test case lacking anticipated outcomes or exact input data. Its purpose is to assess the functionality of a module/system at a broader level, without delving extensively into specific functionalities.

Typically, it focuses on general operations and scenarios, and finds common usage in integration tests, system tests, and smoke tests. It can serve as an initial step towards exploratory testing or the creation of more detailed low-level test cases. Importantly, software test services encompass various testing types beyond those mentioned above.

Low-level Test Case

The low-level test case entails specific input information and anticipated outcomes. Its purpose is to delve into numerous particulars concerning preconditions and encompass all aspects of functionality. These test instances revolve around the user interface (UI) in the application. Typically, novice testers are instructed to primarily focus on developing these particular test cases due to the relative simplicity in generating comprehensive test scenarios compared to discerning which data can be overlooked while ensuring the test case remains highly effective.

Test Case Specification

The test case specification elucidates a collection of test cases (comprising their objectives, input data, variables, circumstances, and anticipated outcomes) for a given test object or item.

The test specification is a comprehensive document that includes both the test design specification and/or the test procedure specification. Its main purpose is to act as a detailed blueprint for executing tests, offering a thorough outline of the design approach and step-by-step instructions for effectively conducting the tests. By providing this comprehensive overview, the test specification enables test teams to maintain consistency, accuracy, and efficiency throughout the testing process.

Test Scenario

The test scenario and test procedure specification encompass the detailed steps involved in conducting tests. The test scenario defines specific situations or conditions to be tested, while the test procedure specification outlines the step-by-step instructions, also referred to as a test script, for carrying out the test. This specification provides a clear and comprehensive outline, enabling testers to execute the tests accurately and consistently.

Software Testing Lab

The software testing lab is a dedicated facility for testing computer software and hardware. It serves as an office where highly precise and effective test cases are written and executed. These test cases are designed to be suitable for both onshore and offshore mobile and web services, ensuring comprehensive testing coverage across various platforms. The lab provides an environment conducive to rigorous testing and quality assurance, ultimately contributing to the development of reliable and robust software and hardware solutions.

Conclusion

In conclusion, test cases are an essential component of software testing, ensuring that applications, systems, or specific features adhere to the requirements outlined in their specifications. By meticulously crafting and following test cases, software testers can systematically evaluate the quality and reliability of the software being tested. Whether it is high-level test cases focusing on general operations or low-level test cases delving into specific functionalities, the use of comprehensive test case specifications and test scenarios enables accurate and consistent execution of tests. Ultimately, the effective utilization of test cases contributes to the development of reliable and robust software solutions in dedicated software testing labs.

About WeTest

WeTest, with over a decade of experience in quality management, is an integrated quality cloud platform dedicated to establishing global quality standards and enhancing product quality. As a member of the IEEE-approved Global Game Quality Assurance Working Group, it is recognized for its commitment to quality assurance. WeTest has served over 10,000 enterprise clients across 140+ countries.

Focusing on advanced testing tools development, WeTest integrates AI technology to launch professional game testing tools such as PerfDog, CrashSight, and UDT (Next-Gen Multi-Terminal Unified Access Management Automated Testing Platform), aiding over a million developers worldwide in boosting efficiency. Additionally, WeTest offers comprehensive testing service solutions for mobile, PC, and console games, covering compatibility, security, functionality, localization testing and other various services, ensuring product quality for over 1,000 game companies globally.

How to Create Lightning-Fast Apps: App Network Testing

wetest — Mon, 22 Jul 2024 08:17:31 +0000

How to provide a seamless user experience in today's digitally connected world? The network performance of your apps plays a critical role, especially when targeting a global audience.

What is Local App Network Testing?

As the name implies, local app network testing evaluates an application's network performance, including communication with servers, network latency, bandwidth, transmission speed, and overall connection quality. The purpose of this testing is to ensure that the application can function optimally in various network conditions, providing a seamless user experience.

Why is Local App Network Testing Necessary?

By testing your app's network performance, you can identify potential issues such as jitter, unstable or slow network, latency, packet loss or other network-related challenges.

Jitter: Jitter refers to the variations in delay between data packets arriving at their destination. It is the inconsistency in the time it takes for packets to travel from the sender to the receiver. Jitter can occur due to network congestion, route changes, or other factors that cause fluctuations in the transmission path of data packets.

Network Stability: Network stability is the consistency and reliability of a network connection, ensuring that the connection remains uninterrupted and maintains a steady flow of data. Issues with network stability can arise due to hardware failures, software bugs, network congestion, or physical factors such as interference or signal degradation.

Speed: Network speed, the rate at which data is transmitted over a network, is a critical aspect of network performance. Speed issues can occur due to network congestion, limited bandwidth, hardware or software issues, or signal interference. A slow network can lead to user frustration and potential churn, emphasizing the need for optimal speed.

Latency: the time it takes for a data packet to travel from the sender to the receiver, significantly affects real-time applications like online gaming or video chatting. High latency can cause lags that disrupt the user experience. Latency can occur due to network congestion, long-distance transmission, or inefficient routing. Reducing latency is crucial for maintaining a responsive and real-time user experience.

Packet Loss: Packet loss refers to the failure of data packets to reach their intended destination. Packet loss can occur due to network congestion, hardware failures, software bugs, or signal interference. Losing data packets during transmission can lead to interruptions and degrade the quality of service.

Some key reasons to conduct app network testing

Diverse Network Feasibility: By testing your app in various network environments, this can ensure your app performs well across different regions and network conditions, including 3G/4G/5G/WiFi, weak network environments, etc.
Optimal User experience: Optimizes network performance, enhancing user satisfaction and increasing the likelihood of positive reviews and recommendations, as these are very important advertisement for a global game.
Issue Diagnosis: Identifies and resolves network-related issues, ensuring a smooth and consistent user experience.
Enhancing Capability: Identifies bottlenecks and enables optimization, which are very important in improving your app's competitiveness in the market.

Our Experiences

At WeTest, we are dedicated to delivering exceptional service that caters to diverse customer needs and efficiently fulfills their requirements. We specializes in the early detection of overseas network issues by assessing various metrics such as:

Network stability
Speed
Latency
Packet loss

This includes:

Video playback smoothness
Game stability in different network environments, such as 3G/4G/5G/WiFi

This helps you understand how your application operates locally, allowing you to make necessary adjustments and optimizations for a seamless gaming experience across various regions.

Network experience test shows a series of network-related data such as latency, upload & download speed, loading time, high-latency scenarios, and more, thus you can have a comprehensive understanding of the local network situation and product performance:

Common network issues we encountered

We've encountered a variety of issues during our network testing experiences of popular games. These challenges have provided valuable insights and helped us improve our services. Here are some common types of problems we've faced:

Matchmaking Issues: Problems with entering game rooms even after the match timer reaches zero, often due to domain name resolution failures.
Geolocation Errors: Clients mistakenly identified as being outside the testing region, causing them to be blocked from accessing the game.
Latency Reporting: Inaccurate latency data due to the inclusion of factors like the client's scene loading time
Packet Loss: Severe packet loss in certain regions and challenges associated with handling large and small packets in the game.
Download Speed: Slow game download speeds in certain regions, leading to longer than expected download times.
Connectivity Issues: Problems with unreachable ping and high latency for certain network operators.

Our advantages

Reliable and Secure: All tests are conducted in a reliable and secure manner to ensure program information confidentiality and compliance.
Expert and Thorough: Our team of experts provides comprehensive network performance evaluations and diverse testing environments.
Cost-Effective: We offer customized testing solutions and professional technical support at competitive prices.
Real-time communication and fast delivery
Original file and video traceback
Guaranteed quality and quantity, with free retesting if necessary

Read the full blog → Local App Network Testing

5 Must-Do Tests for a Game that Goes for the Global Market

wetest — Wed, 17 Jul 2024 08:38:46 +0000

Launching a game in the global market can be a challenging and rewarding endeavor. To ensure your game's success, it is essential to conduct thorough testing in various areas. In this blog, we'll share the five must-do tests for a game that aims to conquer the global market, along with specific examples and details to help you better understand the importance of each test.

1. Network Testing

Network testing is crucial for evaluating the performance of your game in different network environments, such as 3G/4G/5G/WiFi. By assessing network stability, speed, latency, and packet loss metrics, you can identify potential issues and optimize your game for a smooth gaming experience across various regions.

For example, you may discover that your game experiences high latency in certain regions, causing delays and negatively impacting the user experience. By identifying these issues, you can work on optimizing your game's network performance and ensure that players worldwide enjoy a seamless gaming experience.

2. Server Speed Testing

Server speed testing helps you evaluate the response times, loading speeds, and overall performance of your game's servers in various overseas environments. This information allows you to optimize your server deployment, configuration options, and CDN acceleration, ensuring a responsive gaming experience for players worldwide.

For instance, you might find that your game's loading times are significantly longer in a particular region due to server latency issues. By conducting server speed tests, you can identify the root cause of these problems and make the necessary adjustments to improve your game's performance for players in that region.

3. Payment Testing

As your game reaches a global audience, it will encounter numerous payment channels with varying protocols and regulations. Payment testing helps you detect potential issues in the local market, such as payment configuration errors, UI display errors, incorrect pricing, and price discrepancies between different regions/platforms.

For instance, you might find that your game's in-app purchases are not functioning correctly in a specific country due to a payment gateway issue. By conducting payment tests, you can identify and resolve these issues, ensuring a seamless payment experience for your players and avoiding potential revenue loss.

4. Functionality Testing

Functionality testing is essential for detecting user experience issues in actual overseas scenarios. By testing your game's core features and overall user experiences in local overseas environments, you can identify any abnormalities or performance issues and make the necessary adjustments to ensure a smooth and enjoyable gaming experience for your global audience.

For example, you may discover that certain in-game events or quests do not load correctly for players in a specific region, causing frustration and negatively impacting player retention. By conducting functionality tests, you can pinpoint these issues and optimize your game's performance for a diverse global audience.

5. Login Testing

Login testing is vital for ensuring that your game's authentication system works seamlessly across different regions and platforms. By thoroughly testing your game's login process, you can identify any issues related to login methods, account creation, password recovery, and user authentication, providing a smooth and secure login experience for your players.

For example, you may find that players in a certain country are unable to create accounts using their preferred social media platform (via wechat, google mail, x twitter, facebook etc.) due to a login integration issue.
By conducting login tests, you can identify and resolve these problems, ensuring that all players can easily access and enjoy your game.

How to Test Games for a Global Audience

wetest — Tue, 16 Jul 2024 09:10:24 +0000

Are you planning to release your game to a global audience? Are you concerned about how your game will perform in different regions, on various networks, or across numerous payment channels? Local user testing can help you navigate these challenges and ensure your game is ready for a successful global launch.

What is Overseas Local User Testing

Overseas Local User Testing is a comprehensive testing solution that provides real-world scenarios for your game, tested by actual users across the globe. This includes critical aspects such as Network Testing, Payment Testing, and Functionality Testing, and more.

Why is it Essential

When releasing a game to an international audience, you are faced with a variety of challenges that can impact the success of your game:

Regional Differences: With your game being played in multiple regions, you need to account for time zone differences and varying regional preferences. An aspect of your game that works well in one region may not be as effective in another.
Payment Variations: There are numerous payment channels around the world, each with its own set of protocols and regulations. It's crucial to ensure that your game's payment system works seamlessly across all these channels.
Functional Experience: The real-world situation and geographic influences can impact the functionality and user experience of your game. It's important to test how your game performs in real overseas environments.
Network: Different regions have varying network infrastructures and carrier differences. It's essential to test how your game operates under these varying conditions to ensure a smooth gaming experience for all players.
Login Scenarios: Your game may require users to log in using various methods. Testing these login scenarios in different regions will ensure that all players can access your game easily.
Server Deployment: The location and configuration options of your servers can significantly impact your game's performance. It's crucial to test these aspects in a real-world environment.

Overseas testing can also present its own set of challenges, such as slow response times, high costs, and also let's not forget about the time-consuming process of recruiting and managing testers. All these difficulties can slow down your game's release and impact its success.

WeTest Advantages

WeTest offers a range of benefits to help you overcome the challenges of overseas testing:

Extensive Resources: WeTest covers 30+ core countries and 90+ non-core countries for game/app releases, with independent community resources, multiple payment methods and login channels, and a range of low/mid/high-end devices.
Lower Costs: Thanks to our flexible tester model, standardized testing SOPs, and specialized in-house tools, we can offer efficient processes and high execution efficiency at a lower cost.
Support: We can support customized requirements, deliver high-quality reports, and offer a dedicated team with 24/7 support and multi-language communication efficiency.
Better Services: We offer multi-dimensional data metrics, cover core user scenarios, and provide rich documentation for easy access by clients.

Scope of Our Services

WeTest's overseas testing services are built on our overseas testers' expertise. These services include server speed tests, network experience tests, payment tests, and customized functional tests, all designed to meet your specific project requirements.

Key Values of WeTest Services

Our services can help you detect potential network, payment, and functionality issues in your game early on. By understanding how your application operates locally, you can ensure a smooth and enjoyable user experience for your global audience.

Network Testing

WeTest specializes in the early detection of overseas network issues by assessing various metrics such as:

Network stability
Speed
Latency
Packet loss

This includes evaluating the smoothness of:

Video playback
Game stability in different network environments, such as 3G/4G/5G/WiFi

WeTest's network testing services help clients understand how their application operates locally, allowing them to make necessary adjustments and optimizations for a seamless gaming experience across various regions.

Payment Testing

WeTest excels at identifying potential payment issues in the local market, such as:

Payment configuration errors
Payment UI display errors
Incorrect pricing after switching to voice chat
Price discrepancies between different regions/platforms

Additionally, WeTest assesses:

Underpayment for purchases
Missing payment tiers
Disrupted payments
Consecutive small payments

By addressing these issues early on, we can ensure a smooth and secure payment experience for your players and helps you avoid potential revenue loss.

Functionality Testing

WeTest's functionality testing focuses on the early detection of user experience issues in actual overseas scenarios. This involves:

Loading errors or abnormalities: Identifying situations where certain activities may not load or exhibit abnormalities
Core feature performance: Assessing the performance of core features in local overseas environments
Evaluating overall user experiences

Conclusion

By choosing WeTest's Overseas Local User Testing Solutions, you can ensure your game is ready for a successful global launch. Our comprehensive testing solutions will help you navigate the complexities of overseas testing and ensure your game delivers a seamless user experience, regardless of where your players are located.

A Comprehensive Guide to Android NDK Development with Android Studio

wetest — Fri, 12 Jul 2024 09:54:33 +0000

Introduction

The Native Development Kit (NDK) is a collection of tools designed to help developers efficiently create C or C++ dynamic libraries and automatically package the .so files and Java applications into an APK. There are several reasons why developers might choose to use the NDK:

Code protection: Java code in APKs can be easily decompiled, making it vulnerable to reverse engineering. In contrast, C/C++ libraries are more difficult to reverse compile, offering better protection.
Utilization of existing open-source libraries: A vast majority of open-source libraries are written in C/C++ code, making it convenient for developers to incorporate them into their projects.
Enhanced execution efficiency: Developing high-performance application logic using C can significantly improve the execution efficiency of an application, resulting in a better user experience.
Portability: Libraries written in C/C++ can be easily reused on other embedded platforms, making it simpler for developers to port their applications to different devices.

Preparation

For the NDK package download link: http://dl.google.com/android/ndk/android-ndk32-r10-windows-x86_64.zip

After downloading the NDK zip package, extract it to the D:\Android directory:

With this package, there is no need to install Cygwin, as the NDK package already includes integrated Linux compilation functionality. This makes the process more convenient and straightforward for developers.

Steps

Create a new project in Android Studio or add a new module.
This article will not go into detail on how to do this. In my example, I added a new Android library-type module to an existing project, named cloudNDKTest.

Environmental configuration

Click on the menu bar File --> Project Structure, or use the shortcut key Ctrl+Alt+Shift+S. Then, follow the steps shown in the image:

After completing this, a configuration will be generated in the local.properties file:

Write native method
Create a new Java file and declare a static native method. Don't worry if the method name appears in red:

Compile the project
Execute "Make Project" to compile the corresponding class files, which will be needed later when generating the .h files.

Create a JNI directory
Switch the view from Android to Project, and create a JNI directory under the src/main directory, at the same level as the Java directory.

Generate the C++ .h file
Click on the menu bar View --> Tool Windows --> Terminal, or use the shortcut key Alt+F12 to bring up the terminal window:

Then, execute the following command in the Terminal window:

cd cloudndktest/src/main

javah -d jni -classpath D:/Android/android-sdk/platforms/android-22/android.jar;../../build/intermediates/classes/debug com.tencent.XXX.XXX.cloudndktest.CloudNdkTest

Here, javah is the tool needed to generate header files, -d specifies the directory location for file creation, and -classpath specifies the file location of android.jar in the SDK folder. After the semicolon, it specifies the class file generated in step 4.

Finally, it will generate:

Write the CPP file
Create a CPP file in the JNI directory, and do not check the part marked in red below, as the .h file already exists.

Write the CPP file, include the previously created .h file, and implement the specific function.

Compile
a. First, add the following content to the module's build.gradle:

The above configuration code specifies the .so library name as CloudNdkTest; the library used during linking, corresponding to the LOCAL_LDLIBS in the Android.mk file; and the final output specifies the .so library under three ABI architectures.

b. Configure the gradle.properties file and add:

android.uesDeprecatedDNK=true

c. Add a reference to the static library in the Java class written in step

d. If you encounter the following error, please create an empty util.c file in the JNI directory. This is said to be a bug in the NDK.

e. Execute "Make Project" to compile the project.

Precautions

If the CPP implementation uses the STL library, you need to add the following in step 8.a:

Currently, several compilation and linking methods are supported:

stlport_static --> Use the stlport version of STL with static linking
stlport_shared --> Use the stlport version of STL with dynamic linking

gnustl_static --> Use the GNU version of STL with static linking

It is important to note that it is better to compile through static libraries, as this will not cause conflicts between .so files in multiple modules and will also reduce the final package file size.

For more information, check out WeTest services.

How to Do Android App Security Testing: A Guide for Developers and Testers

wetest — Wed, 10 Jul 2024 01:57:57 +0000

Introduction

As a die-hard fan of Android phones, if your phone suddenly drops, would your first thought be "Oh my god!" or that your money in Google Pay or Paypal is not safe? If the latest downloaded app not only pops up various boring ads but also unexpected notifications, would you think it might be a phishing attempt and immediately uninstall the app?

How can we ensure that our app provides a safe experience for users who have insufficient awareness of Android security vulnerabilities? What are the security vulnerabilities in the Android ecosystem? Where can we explore new Android security testing techniques? How can we streamline the security testing process?

Common Android Security Vulnerabilities

Firstly, the open-source development advantage of the Android operating system also conceals inherent security issues in its development, such as the Android system's sandbox system (i.e., virtual machine). However, the underlying layer has one vulnerability after another, allowing malicious programs (or tools) to gain root access and break the sandbox's restrictions. Just like in the PC era, there is no absolutely secure PC operating system; in the mobile internet era, there is no absolutely secure mobile operating system either. The security risks of the Android open-source ecosystem are like blood-stained alarm bells, striking the hearts of every Android developer.

Secondly, the security risks in the Android APP/SDK development process are like unknown black holes. We never know where the endpoint of security confrontation is, who the attackers are, who the terminators are, and how to defend against them.

Finally, at the user level, what are some common and recognizable security behavior vulnerabilities?

Both Android Apps and SDKs have security vulnerabilities to some extent. Perhaps one day, your application might be affected by one of the above security vulnerabilities. Coincidentally, while testing an Android SDK recently, we discovered a security vulnerability related to Android application components. Based on this example, the methods, techniques, and processes for Android SDK security testing are summarised.

Android APPs' Security Testing Examples

Overview of Vulnerability Causes
An optional component of an application (hereinafter referred to as the application) Android SDK has opened a random port locally to monitor whether the Java layer service is alive. However, when the Java layer communicates with the component, it does not strictly check the input parameters, resulting in the possibility of being filled with attack code and malicious attacks when calling the "system()" function of the Linux system.

The following screenshot shows that after the simulation port is attacked, the application component intent modifies the URL content during communication, and the Webview displays garbled code:

Potential Security Risks of the Vulnerability

The four major application components of Android APPs: Activity, Receiver, Service, and Content Provider, as well as the security roles of application components communicating through intent for IPC, will not be discussed in detail here. Leveraging the component-related vulnerability in the above example, the following diagram shows the attack dimensions related to the terminal APP side:

Due to the local application environment of Android APP, the network socket is inherently lack of fine-grained authentication and authorization mechanism. Therefore, if the Android client is used as the server, the reverse code is used to search the local random port number of the application, and the attack is actively sent to the port, the following security hazards will lurk:

Local command execution: When the Package name of the embedded application is specified as the application itself and the Component name is specified as the activity of the application, any activity of the application can be started, including the protected non-exported activity, thus causing a security hazard. For example, a denial of service vulnerability can be found by starting several unexported activities one by one through HTTP requests.
Command control to modify application permissions: Pass in the intention to start Android application components through the open socket port, and then execute operations such as starting activity and sending broadcast with the permissions of the attacked application. Because the intents passed in through the socket cannot perform fine-grained checks on the identity and permissions of the sender, bypassing the permission protection provided by Android for application components, and can start the unexported and permission-protected application components, posing a security hazard
Sensitive information disclosure, mobile phone control: A local service opens the UDP port to listen, and after receiving a specific command word, it can return the sensitive information of the mobile phone. For example, Baidu mobile phone butler can remotely manage the cell phone's secretKey, and then unauthorized attackers can fully manage the cell phone through the network.

Android Security Testing Execution

Android Security Hardening Version Optimization

Add checks for system commands and special character filtering in both the Native and Java layers.
Encrypt socket communication for JNI Watchdog daemon process.
Add feature verification for URLs, intents, and activities in local notification functions to prevent redirection to malicious links when clicking on notifications.
Change the storage location of Package name in the app's local storage.
Add online configuration functionality.

These are the important requirements for this security hardening optimization.

Special Security Testing

If you follow conventional system testing or performance testing, you only need to perform forward testing based on the changing requirements. However, for security testing, ensuring the robustness of the SDK's security requires reverse special testing, simulating various security attack methods, and diverging test cases for the modified points.

Android Regular Security Regression Testing

Privacy data: External storage security and internal storage security; check if user names, passwords, chat records, configuration information, and other private information are saved locally and encrypted; verify the integrity of the information before using it.
Permission attacks: Check the app's directory and ensure that its permissions do not allow other group members to read or write; check if system permissions are under attack.
Android component permission protection: Prevent app internal components from being arbitrarily called by third-party programs: prevent Activities from being called by third-party programs, prevent Activity hijacking; ensure Broadcast reception and transmission security, only receive broadcasts sent out by the app, and prevent third parties from receiving transmitted content; prevent maliciously starting or stopping services; check Content Provider operation permissions; if components need to be called externally, verify if signature restrictions have been applied to the caller.
Upgrades: Check the integrity and legality of the upgrade package to avoid hijacking.
3rd-party libraries: If third-party libraries are used, follow up on their updates and check their security.
ROM security: Use official ROMs or ROMs provided by authoritative teams to avoid the addition of implanted ads, Trojans, etc.
Anti-cracking countermeasures: Counteract decompilation, making it impossible to decompile using decompilation tools or obtain the correct disassembly code after decompilation; counteract static analysis by using code obfuscation and encryption; counteract dynamic debugging by adding code to detect debuggers and emulators; prevent recompilation by checking signatures and verifying the hash value of the compiled dex file.

After completing the security special testing and regular process testing, perform rolling regression testing for the app's existing features, compatibility between new and old versions, and compatibility with different Android operating system versions.

Wrap-up

Compared to ordinary performance and system functionality test cases, security test cases require a more comprehensive understanding of the Android ecosystem, such as: covering user security appearance level, application system local and remote attack level, and operating system vulnerability level, with more focus on designing reverse attack thinking test cases.

If the starting point of development is security defense, the starting point of testing is the hacker attack mindset. Designing test cases for attack scenarios and implementing attack testing techniques determines the robustness of the SDK's security.

To ensure the highest level of security for your applications, consider utilizing WeTest Application Security Testing. This service provides a comprehensive evaluation of security issues in applications, timely detection of program vulnerabilities, and offers code repair examples to assist with vulnerability repairs.

Trust WeTest to safeguard your application against potential threats and maintain a secure user experience.