WordPress.org

پښتو

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawlers

Plugin Tag: crawlers

  • Robots.txt rewrite

    (2 total ratings)

    Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

    Eugen Bobrowski 2،000+ active installations Tested with 4.7.29

  • Block AI Crawlers

    (2 total ratings)

    Tells AI companies not to access and scrape your site for AI.

    Bob Matyas 200+ active installations Tested with 6.6.2

  • Dark Visitors

    (3 total ratings)

    Track and control artificial agents crawling your website including AI assistants, scrapers, and other bots.

    Dark Visitors 200+ active installations Tested with 6.6.2

  • Robots Meta Whiz

    (0 total ratings)

    Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.

    Marat Nepomnyashy 100+ active installations Tested with 4.7.29

  • MetaRobots by SEO-Sign

    (1 total ratings)

    The easiest way to manage meta robots tag.

    Artem Pilipec 100+ active installations Tested with 4.1.41

  • Seo Crawlytics Data Export & Delete

    (0 total ratings)

    Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.

    Apasionados.es 30+ active installations Tested with 6.3.5

  • Log-Hero.com Plugin

    (1 total ratings)

    Analyze how search engines and other bots crawl and understand your web page. The official PHP Wordpress plugin for log-hero.com.

    Kay Wolter 30+ active installations Tested with 4.9.26

  • LJPL Armored robots.txt

    (0 total ratings)

    Add some directives to your robots.txt file to keep your site safer

    Łukasz Jasiński 20+ active installations Tested with 3.4.2