Title: Plugins categorized as crawler | WordPress.org Sinhala --- සෙවීම * [All](https://si.wordpress.org/plugins/) * [Community](https://si.wordpress.org/plugins/tags/crawler/?plugin_business_model=community) * [Commercial](https://si.wordpress.org/plugins/tags/crawler/?plugin_business_model=commercial) # Plugin Tag: crawler * ![](https://ps.w.org/email-address-encoder/assets/icon-256x256.jpg?rev=970206) * ### 󠀁[Email Address Encoder](https://si.wordpress.org/plugins/email-address-encoder/)󠁿 * (160 total ratings) * A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities. * Till Krüss 100,000+ active installations Tested with 7.0 * ![](https://ps.w.org/robots-txt-editor/assets/icon-256x256.jpg?rev=2081244) * ### 󠀁[Robots.txt Editor](https://si.wordpress.org/plugins/robots-txt-editor/)󠁿 * (8 total ratings) * Robots.txt for WordPress * Processby 10,000+ active installations Tested with 5.6.17 * ![](https://ps.w.org/spider-analyser/assets/icon-256x256.png?rev=2338422) * ### 󠀁[Spider Analyser – WordPress搜索引擎蜘蛛分析插件](https://si.wordpress.org/plugins/spider-analyser/)󠁿 * (1 total ratings) * Spider Analyser是一款用于跟踪WordPress网站各种搜索引擎蜘蛛爬行日志的插件，并进行 详细的蜘蛛爬行数据统计、蜘蛛行为分析、蜘蛛爬取分析及伪蜘蛛拦截等。 * wbolt.com 4,000+ active installations Tested with 6.8.5 * ![](https://ps.w.org/no-bot-registration/assets/icon-256x256.jpg?rev=3113674) * ### 󠀁[No-Bot Registration](https://si.wordpress.org/plugins/no-bot-registration/)󠁿 * (27 total ratings) * Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question. * Arnan 2,000+ active installations Tested with 6.9.4 * ![](https://ps.w.org/robotstxt-rewrite/assets/icon-128x128.png?rev=1409259) * ### 󠀁[Robots.txt rewrite](https://si.wordpress.org/plugins/robotstxt-rewrite/)󠁿 * (2 total ratings) * Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too. * Eugen Bobrowski 1,000+ active installations Tested with 4.7.33 * ![](https://ps.w.org/marquee-image-crawler/assets/icon-256x256.png?rev=2445778) * ### 󠀁[Marquee image crawler](https://si.wordpress.org/plugins/marquee-image-crawler/)󠁿 * (1 total ratings) * Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right. * gopiplus 700+ active installations Tested with 6.1.10 * ![](https://ps.w.org/mass-ping-tool-for-seo/assets/icon-256x256.jpg?rev=2741945) * ### 󠀁[Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …](https://si.wordpress.org/plugins/mass-ping-tool-for-seo/)󠁿 * (4 total ratings) * Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in … * Pagup 600+ active installations Tested with 6.9.4 * ![](https://ps.w.org/block-archive-org-robots-txt/assets/icon-256x256.jpg?rev =1922069) * ### 󠀁[Block Archive.org via WordPress robots.txt](https://si.wordpress.org/plugins/block-archive-org-robots-txt/)󠁿 * (0 total ratings) * Blocks the archive.org bots through the WordPress virtual robots.txt file. * apasionados 500+ active installations Tested with 6.9.4 * ![](https://ps.w.org/db-robotstxt/assets/icon.svg?rev=2956961) * ### 󠀁[Bisteinoff SEO Robots.txt](https://si.wordpress.org/plugins/db-robotstxt/)󠁿 * (4 total ratings) * An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO). * Denis Bisteinov 500+ active installations Tested with 6.9.4 * ![](https://s.w.org/plugins/geopattern-icon/bodi0s-bots-visits-counter_f2f7f9. svg) * ### 󠀁[bodi0`s Bots visits counter](https://si.wordpress.org/plugins/bodi0s-bots-visits-counter/)󠁿 * (5 total ratings) * Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings. * Budiony Damyanov 100+ active installations Tested with 6.1.10 * ![](https://ps.w.org/block-chat-gpt-via-robots-txt/assets/icon-256x256.jpg?rev =2893474) * ### 󠀁[Block Chat GPT via robots.txt](https://si.wordpress.org/plugins/block-chat-gpt-via-robots-txt/)󠁿 * (1 total ratings) * Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file * apasionados 100+ active installations Tested with 6.3.8 * ![](https://ps.w.org/block-ecommerce-assets-via-robots-txt/assets/icon-256x256. jpg?rev=2370844) * ### 󠀁[Block eCommerce Assets via robots.txt](https://si.wordpress.org/plugins/block-ecommerce-assets-via-robots-txt/)󠁿 * (0 total ratings) * Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt * apasionados 100+ active installations Tested with 6.3.8 * ![](https://ps.w.org/warmer/assets/icon.svg?rev=3210700) * ### 󠀁[Warmer](https://si.wordpress.org/plugins/warmer/)󠁿 * (3 total ratings) * Automatically warm up your WordPress site's cache by crawling pages to ensure optimal performance for your visitors. * Atakan Oz 60+ active installations Tested with 6.8.5 * ![](https://ps.w.org/findkit/assets/icon.svg?rev=3011976) * ### 󠀁[Findkit – Site Search](https://si.wordpress.org/plugins/findkit/)󠁿 * (0 total ratings) * Powerful cloud based search engine for your website. Search as you type, real- time index updates, and embeddable UI. Free for small websites. * Findkit Team 50+ active installations Tested with 6.9.0 * ![](https://ps.w.org/ai-deny/assets/icon-256x256.png?rev=3410148) * ### 󠀁[AI Deny](https://si.wordpress.org/plugins/ai-deny/)󠁿 * (1 total ratings) * Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay. * Code For Broke 40+ active installations Tested with 6.9.4 * ![](https://ps.w.org/block-common-crawl-via-robots-txt/assets/icon-256x256.jpg? rev=2915353) * ### 󠀁[Block Common Crawl via robots.txt](https://si.wordpress.org/plugins/block-common-crawl-via-robots-txt/)󠁿 * (0 total ratings) * Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file * apasionados 30+ active installations Tested with 6.3.8 * ![](https://ps.w.org/block-feed-and-comments-via-robots-txt/assets/icon-256x256. jpg?rev=2371412) * ### 󠀁[Block Feed and Comments via robots.txt](https://si.wordpress.org/plugins/block-feed-and-comments-via-robots-txt/)󠁿 * (0 total ratings) * Blocks some Feed and Comment resources in order to avoid spam bots * apasionados 30+ active installations Tested with 6.3.8 * ![](https://ps.w.org/azayem-bots-tracker/assets/icon-256x256.png?rev=3427328) * ### 󠀁[Azayem Bots Tracker – Bot Visits Logger](https://si.wordpress.org/plugins/azayem-bots-tracker/)󠁿 * (0 total ratings) * A custom plugin to log search engine bot visits and analyze their crawl budget directly inside WordPress (no external services required). * botstracker 10+ active installations Tested with 6.9.4 * ![](https://ps.w.org/seobot-monitor/assets/icon-256x256.png?rev=2504973) * ### 󠀁[SEObot Monitor for Googlebot, Bingbot and search engine spiders](https://si.wordpress.org/plugins/seobot-monitor/)󠁿 * (0 total ratings) * With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete … * Santiago Alonso 10+ active installations Tested with 5.8.13 * ![](https://ps.w.org/page-modified/assets/icon-256x256.png?rev=1785758) * ### 󠀁[Page Modified](https://si.wordpress.org/plugins/page-modified/)󠁿 * (1 total ratings) * Display the results of your Page Modified crawls right within your WordPress Admin. * Chris Klosowski 10+ active installations Tested with 4.9.29 ## Posts pagination 1 [2](https://si.wordpress.org/plugins/tags/crawler/page/2/?output_format=md) [ඊළඟ](https://si.wordpress.org/plugins/tags/crawler/page/2/?output_format=md)