Monitoring competitors on marketplaces is a key task for any online seller. Knowing the assortment, prices, reviews, and strategies of other sellers allows for informed decision-making and staying ahead of the competition. In this guide, we will explore practical methods for collecting data on sellers from Wildberries, Ozon, Yandex.Market, and other platforms, as well as ways to bypass anti-bot protection.
Why Collect Data on Marketplace Sellers
Collecting information about competitors is not just curiosity; it is a necessity for successful business operations on marketplaces. Here are the main reasons why sellers regularly monitor other participants on the platform:
Analyzing Competitors' Pricing Strategies. Knowing the prices at which similar products are sold by other sellers allows you to adjust your prices to enhance competitiveness. Many successful sellers use dynamic pricingâautomatically changing prices based on competitors' actions.
Studying Assortment and Trends. Tracking which products appear among competitors helps identify new niches and growing demand. If several sellers simultaneously add a certain category of products, it may signal a promising direction.
Monitoring Reviews and Reputation. Analyzing reviews on competitors' products allows you to understand what customers like and what causes dissatisfaction. This information can be used to improve your own products and descriptions.
Evaluating Promotion Strategies. Studying how competitors use photos, descriptions, keywords, and promotions provides ideas for your own marketing activities. It is especially useful to analyze successful sellers in your niche.
Finding Suppliers and Manufacturers. Sometimes, data about a seller can lead to common suppliers or reveal where competitors source their products. This helps optimize your own supply chain.
What Data on Sellers Can Be Collected
Marketplaces provide varying amounts of public information about sellers. Here are the main types of data that can be collected for competitor analysis:
Basic Seller Information: store name, rating, number of reviews, registration date on the platform, legal entity (if specified), contact information.
Product Assortment: list of all products sold by the seller, categories, brands, SKUs, specifications, photos, descriptions, stock availability.
Pricing Information: current prices, discounts, price change history, participation in marketplace promotions, prices considering promo codes.
Reviews and Ratings: number of reviews for each product, average rating, text of reviews, photos from customers, seller responses to reviews.
Sales Metrics: number of orders (if available), stock dynamics, product popularity, positions in marketplace search results.
Different marketplaces provide varying levels of access to information. For example, on Wildberries, you can see the number of orders in recent times, while on Ozon, this information is hidden. On Avito, the seller's activity history is available, while on Yandex.Market, detailed delivery characteristics are provided.
Marketplace Parsing Methods: Manual vs Automatic
There are several approaches to collecting data on sellers in marketplaces. The choice of method depends on the volume of data, update frequency, and technical skills.
Manual Data Collection
The simplest way is to manually browse seller pages and record the necessary information in an Excel or Google Sheets table. This method is suitable for one-time studies or analyzing a small number of competitors (5-10 sellers).
Advantages of Manual Collection: does not require technical skills, no additional tools needed, low risk of blocking, allows for collecting quality information considering context.
Disadvantages: very slow, labor-intensive, impossible to track changes in real-time, high likelihood of errors during manual entry, not scalable.
Ready-Made Services for Parsing
There are specialized services for monitoring marketplaces that provide ready-made solutions for data collection. Examples include MpStats, SellerFox, Moneyplace, DataOx, Price Tracker, and others.
Advantages of Ready-Made Services: work "out of the box," require no setup, provide analytics and data visualization, automatically bypass marketplace protection, regularly update when site structures change.
Disadvantages: monthly subscription (from 2000 to 15000 rubles), limitations on the number of requests, collect only a standard set of data, dependence on the stability of the service's operation.
Automatic Parsing Using Parsers
For those who want complete control over the data collection process, there are special parser programs. They automatically load marketplace pages, extract the necessary information, and save it in a convenient format.
Popular tools for parsing include Octoparse, ParseHub, WebHarvy, Scrapy (for programmers), and Selenium (for browser automation). These tools allow you to set up the collection of exactly the data you need, without the limitations of ready-made services.
Advantages of Parsers: flexible configuration for any tasks, can collect unique data, no limitations on the number of requests, one-time purchase or free solutions, complete control over the process.
Disadvantages: requires time for setup, basic technical skills needed, must configure protection bypass manually, adjustments required if the site structure changes.
How Marketplaces Protect Against Parsing
Marketplaces actively combat automated data collection, as mass parsing creates additional load on servers and can be used by competitors. Here are the main protection methods you will encounter:
IP Address Limitation. The most common protection is blocking IP addresses from which too many requests come in a short time. Wildberries and Ozon monitor request frequency and temporarily block suspicious IPs for several hours or days.
Captcha and Bot Verification. Upon detecting suspicious activity, the marketplace may display a captcha or a "Are you a robot?" verification page. This halts automatic parsing until the captcha is solved manually.
User-Agent and Header Analysis. Websites check where the request is coming fromâwhether from a browser or a program. Requests without the correct headers (User-Agent, Referer, Accept-Language) are often automatically blocked.
JavaScript Protection and Dynamic Loading. Many marketplaces load data via JavaScript after the page opens. Simple parsers that just download HTML do not see this data and receive empty pages.
Honeypot Traps. There may be hidden links on pages that are invisible to regular users but accessible to parsers. Clicking on such links identifies the bot and leads to blocking.
Changing HTML Structure. Marketplaces periodically change CSS class names and page structures to break configured parsers. This requires regular updates to data collection settings.
Choosing Proxies for Parsing Seller Data
Using proxies is a mandatory condition for successful parsing of marketplaces. Proxies allow you to bypass IP address restrictions and make requests on behalf of different users. The choice of proxy type depends on the task and budget.
Comparison of Proxy Types for Parsing
| Proxy Type | Speed | Risk of Blocking | Price | When to Use |
|---|---|---|---|---|
| Datacenter Proxies | Very High | High | Low | Mass parsing with rotation, collecting public data |
| Residential Proxies | Average | Low | Average | Parsing with protection against blocking, long-term monitoring |
| Mobile Proxies | Average | Very Low | High | Parsing with maximum protection, bypassing complex protection |
Datacenter Proxies for Parsing
This is the fastest and cheapest option for parsing large volumes of data. Datacenter proxies are located on hosting provider servers and provide high page loading speeds.
When Suitable: for collecting public data that does not require authorization; when using a pool of 50-100+ IPs with automatic rotation; for parsing small marketplaces with weak protection.
Limitations: Datacenter IPs are easily identified by marketplaces and are more frequently blocked; Wildberries and Ozon actively filter such IPs; a large pool of addresses is required, and request speeds may be slow.
Residential Proxies for Parsing
Residential proxies use IP addresses from real home internet providers. For marketplaces, such requests appear as actions of ordinary customers, significantly reducing the risk of blocking.
When Suitable: for regular competitor monitoring on Wildberries and Ozon; when parsing data that requires authorization; for long-term projects with daily data collection; when stability and low risk of blocking are important.
Usage Features: requests can be made slower, mimicking real user behavior; suitable for parsing through browser automation (Selenium, Puppeteer); provide access to regional versions of marketplaces.
Mobile Proxies for Complex Cases
Mobile proxies use IP addresses from mobile operators. This is the most reliable type of proxy for bypassing protection, as marketplaces are extremely cautious about blocking mobile IPsâthousands of real users may be behind one address.
When Suitable: when parsing marketplaces with very strict protection; when other types of proxies are already blocked; for collecting data through marketplace mobile applications; when maximum reliability is required.
Limitations: higher cost compared to residential proxies; usually, several users share one IP (shared IP); speed may be lower than wired proxies.
Ready-Made Services and Tools for Data Collection
For those who do not want to set up parsing themselves, ready-made solutions are available. Let's look at popular services for monitoring various marketplaces.
Services for Wildberries
MpStats â one of the most popular services for analyzing Wildberries. Allows tracking competitor sales, monitoring prices, analyzing reviews, and finding promising niches. Price starts at 3990 rubles per month. Provides ready-made reports and graphs, requires no technical skills.
SellerFox â a service focused on seller analytics. Shows sales dynamics, stock levels, price history. Has a feature for tracking specific sellers and notifications about changes. Price starts at 2500 rubles per month.
Moneyplace â a comprehensive platform for marketplace analysis with an emphasis on finding products for sale. Includes competitor monitoring, niche analysis, and trend tracking. Subscription starts at 5000 rubles per month.
Services for Ozon
Ozon Seller â the official seller's cabinet of Ozon provides basic competitor analytics. You can view average prices in the category and the positions of your products relative to other sellers. Free for Ozon sellers.
DataOx â a specialized service for parsing Ozon and other marketplaces. Collects data on products, prices, and sellers. Works through API, suitable for integration with your own systems. Price depends on the volume of requests.
Price Tracker â a service for tracking price changes on Ozon. You can add competitor products and receive notifications about price decreases or increases. There is a free plan with limitations.
Universal Parsers
Octoparse â a visual parser that does not require programming. Allows you to set up data collection from any website, including marketplaces. There are ready-made templates for popular platforms. Free version with limitations, paid version starts at $75 per month.
ParseHub â an alternative to Octoparse with a simpler interface. Suitable for beginners. Can work with JavaScript sites and authorization. Free version allows the creation of up to 5 projects, paid version starts at $149 per month.
WebHarvy â a desktop program for parsing. Works on your computer, does not require cloud services. Suitable for one-time tasks. One-time purchase is about $139, free trial version for 15 days.
Step-by-Step Guide: Setting Up Parsing with Proxies
Let's consider a practical example of setting up data parsing for sellers on Wildberries using a ready-made tool and proxies. For this example, we will take Octoparseâone of the most accessible visual parsers.
Step 1: Preparing Tools
Download and install Octoparse from the official website. Register and log into the program. The free version allows you to create up to 10 parsing tasks, which is sufficient to start.
Obtain access to proxies. For parsing Wildberries, residential proxies with Russian IP addresses are recommended. You will need: proxy server IP address, port, username, and password (if authentication is required).
Step 2: Setting Up Proxies in Octoparse
Open Octoparse and go to settings (gear icon in the upper right corner). Select the "Network" or "Proxy" section. Enable the "Use proxy server" option.
Enter your proxy details: in the "Proxy Host" field, specify the IP address, and in the "Port" field, specify the port. If the proxy requires authentication, check the "Authentication required" box and enter the username and password. Save the settings.
Check the connection: click the "Test" button. The program should confirm a successful connection to the proxy. If an error appears, check the accuracy of the entered data.
Step 3: Creating a Parsing Task
Create a new task: click "New Task." Enter the URL of the seller's page on Wildberries from which you want to collect data. For example, the page with all products from a specific store.
Octoparse will open an embedded browser and load the specified page through the proxy. Wait for the page to fully load. If everything is set up correctly, you will see Wildberries content as if you were accessing it from the proxy's IP address.
Step 4: Selecting Data to Collect
Use Octoparse's element selection tool: click on the product name on the page. The program will automatically identify all similar elements (all product names) and highlight them. Click "Select all."
Repeat the process for other data: prices, ratings, number of reviews, images. Each time, Octoparse will add a new field to the data table on the right. Check that all necessary data is selected.
If products are located on multiple pages, set up pagination: find the "Next Page" button and instruct Octoparse to navigate through it. The program will automatically collect data from all pages.
Step 5: Configuring Collection Parameters
Set delays between requests: in the task settings, find "Action Settings" and set "Wait time" to 3-5 seconds between page loads. This simulates real user behavior and reduces the risk of blocking.
Configure User-Agent: in advanced settings, select a random User-Agent from Chrome or Firefox. This makes requests more similar to actions of regular users.
Enable error handling: set the "Retry on error" option with 2-3 attempts. If the page does not load the first time, Octoparse will automatically try again.
Step 6: Running the Parsing
Save the task and click "Run." Choose the execution mode: "Local" (on your computer) for small volumes or "Cloud" (in the cloud) for larger tasks. Cloud mode works faster but is only available in the paid version.
Monitor the process: Octoparse will show the progress of data collection in real-time. You will see how many pages have been processed and how many records have been collected. If errors occur, the program will display a notification.
After completion, export the data: click "Export" and choose the formatâExcel, CSV, JSON, or direct upload to a database. The data will be saved to your computer in a convenient format for analysis.
Step 7: Automating Regular Collection
For regular competitor monitoring, set up a schedule: in the task settings, select "Schedule" and specify the frequency of executionâdaily, weekly, or at a specific time.
Set up notifications: enable email notifications about the completion of parsing or errors. This will allow you to respond quickly to issues.
For advanced users: set up automatic data uploads to Google Sheets or your CRM system. Octoparse supports integration via API and webhooks.
Important: Even when using proxies, maintain reasonable intervals between requests. It is recommended to make no more than 1 request every 3-5 seconds. Too aggressive parsing can lead to blocking even with quality proxies.
Legal Aspects of Marketplace Parsing
Parsing websites exists in a gray area of legislation. On one hand, public information on websites is accessible to all users. On the other hand, mass automated data collection may violate the platform's user agreement.
What the Law Says
In Russia, there is no specific law that explicitly prohibits website parsing. Collecting publicly available information is not a violation in itself. However, there are several legal risks:
Violation of User Agreement. Most marketplaces explicitly prohibit automated data collection in their Terms of Service. Technically, this is not a criminal offense, but the platform may block your account if you are registered as a seller.
Creating Load on the Server. If your parsing creates significant load on the website's infrastructure (DDoS-like activity), it may be classified as a computer crime under Article 273 of the Criminal Code of the Russian Federation. However, this requires a truly enormous load.
Using Collected Data. Parsing itself is one thing, while using the data is another. If you publish the collected data or use it for unfair competition, it may lead to lawsuits from rights holders.
How to Minimize Risks
To reduce legal risks when parsing marketplaces, follow these recommendations:
Collect Only Public Data. Do not attempt to bypass authorization or access closed sections. Parse only the information available to any visitor of the site without registration.
Do Not Create Excessive Load. Use delays between requests, do not launch dozens of parallel parsing threads. Your activity should not affect the website's operation for regular users.
Use Data for Internal Analysis. The collected information should be used for your businessâcompetitor analysis, pricing, market research. Do not publish large datasets publicly or sell them.
Do Not Impersonate Another User. Do not use someone else's accounts for parsing. If authorization is needed, use your account or parse without authorization.
Study robots.txt. Although this file has no legal force, it shows the website owner's attitude towards automated data collection. Complying with robots.txt instructions demonstrates good faith.
Alternatives to Parsing
Some marketplaces provide official APIs for data retrieval. For example, Yandex.Market has an API for partners, and Ozon provides an API for sellers. Using official APIs is a legal and safe way to obtain data.
There are also specialized marketplace analytics services (MpStats, SellerFox) that take on legal risks and provide data within their licensing agreements. Using such services shifts responsibility to the service provider.
Conclusion
Collecting data on sellers in marketplaces is an important tool for competitive intelligence for any online business. Regular monitoring of prices, assortment, and competitors' strategies allows for informed decision-making and maintaining competitiveness.
The choice of parsing method depends on your tasks and resources: manual collection is suitable for one-time studies, ready-made services are for regular monitoring without technical skills, and self-configured parsers are for complete control and flexibility.
The key to successful parsing is the right choice and configuration of proxies. For most tasks on Russian marketplaces, the optimal solution will be residential proxies with Russian IP addressesâthey provide a low risk of blocking at a reasonable cost and allow for long-term competitor monitoring without technical issues.
Remember to adhere to reasonable limits when parsing: use delays between requests, do not create excessive load on marketplace servers, and apply the collected data ethicallyâfor analysis and the development of your own business, not for unfair competition.