Crawlomatic Multipage Scraper Post Generator
Antivirus scan
Powered by ClamAV
✅ Verified clean
This product file has passed our security filters.
Want to run a fresh ClamAV scan right now? Takes a few seconds and shows scanner version, signature DB and live result.
This can take 5 to 30 seconds.
Clean file Threat detected
No threats detected in this file.
- File
- Size
- Scanned
- ClamAV
- Signature database
⚡ Powered by ClamAV
Scan could not be completed
Report product
If you detected an issue (broken file, malware, inappropriate content, etc.) let us know and we'll review it ASAP.
Sign in to report
About Crawlomatic Multipage Scraper Post Generator
For people who want web content without an API, not for those who want original content
Building a site with content that lives on other websites usually ends in manual copy and paste, or in depending on APIs that require registration and limit access. Crawlomatic Multipage Scraper Post Generator takes another route: it crawls web pages and turns what it finds into WordPress posts, or shows it live on your pages.
It suits anyone who needs to automate a content flow and has no API at hand. It does not suit those who expect a plugin that writes original text, or a magic button that needs no setup: you have to provide the starting URL, the extraction rules and the crawl limits.
- Copying other people's content as is can cause copyright and ranking problems. Check what you publish and where you get it from.
- If the source site loads its content with JavaScript, the plugin can be combined with PhantomJS to extract it. It does not work on its own.
- If the source changes its structure, you will have to adjust the rules.
How Crawlomatic crawls: from one starting URL to your posts
You give it a seed URL and the plugin finds all the links on that page, visits each one and extracts the content. The crawl is controlled with several settings:
- Crawl depth, to decide how many levels of links it follows.
- Crawl rate.
- Maximum number of crawled articles.
- Follow only links with a specific class or ID.
You can schedule it once and let it publish automatically, and create as many crawl tasks as you need.
Live data with the crawlomatic-scraper shortcode
Besides generating posts, the plugin includes a live scraper: a shortcode that displays data from another website directly in a post, a page or the sidebar (through a text widget), or through a template tag. It works for things like stock quotes or sports scores from public domains.
What you can configure
- Content querying with CSS selector, XPath, Regex or automatic detection.
- Data caching with a timeout defined in minutes for each piece of data, so your site is not overloaded.
- Your own user agent on each scrape.
- Error handling, timeout and other default values.
- Character encoding conversion, for sites that use a different character set.
- Passing POST arguments to the URL and dynamic URL generation from your page's GET or POST arguments.
- Callback function for more detailed parsing of the data.
What else Crawlomatic Multipage Scraper Post Generator does with your posts and products
- Automatically update scraped posts, pages or products if the source site changes, and set them to draft if the URL no longer exists (both options can be enabled or disabled).
- Scrape product variants from WooCommerce or Shopify stores.
- Scrape product image galleries for WooCommerce. For other content types, the images are created as attachments.
- Scrape search engine results (Google or Bing) for your keywords.
If you plan to build a store with products from another one, check in the demo how categories, prices and images are assigned before launching a large crawl.
Frequently asked questions about Crawlomatic Multipage Scraper Post Generator
Do I need to know how to code?
It helps to understand CSS selectors, XPath or regular expressions to extract titles, images or text properly from each site.
Does it work with sites that load content with JavaScript?
Yes, by combining it with PhantomJS. Without that combination, those sites may give you incomplete results.
Can I use it without creating posts?
Yes. The live shortcode displays data from another site without publishing anything, with configurable caching.
Does it work for WooCommerce?
Yes: it extracts product variants from other WooCommerce or Shopify stores and product image galleries for WooCommerce, and you need WooCommerce installed on your site.
Can it be fully automated?
Yes, you can schedule the crawls so they publish on their own.
Version history
-
v
2.7.3 Current 22 May 2026
-
v
2.7.2 6 Mar 2026
Customer reviews
Sign in to leave a review. Only people who have the product can review it.
No reviews for this product yet.
Frequently asked questions
-
GPL (General Public License) is the license under which WordPress and most premium plugins/themes are distributed. It grants you the right to use, modify and redistribute the software in as many projects as you want, with no domain restrictions.
-
Yes. With membership you get automatic updates via our GPLClub Updater plugin (installed on your WP, detects new versions and applies them). With individual purchase, you get one year of manual updates from your account.
-
Depends on the plan. Monthly: 3 domains. Semi-annual: 7. Annual and Lifetime: 15. Individual purchase: 1 domain.
-
GPLClub offers its own support for installation, configuration and compatibility. For direct support from the original author (feature requests, product-specific bugs), a license purchased from the author is required.
