WordPress.org

Friulian

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawler

Plugin Tag: crawler

  • Boring Cache Warmup Lite

    (2 total ratings)

    A lightweight, privacy-friendly WordPress cache warmup tool. No external services, no drama.

    chriskubisch 10+ active installations Tested with 7.1

  • Trackbase Analytics

    (0 total ratings)

    Official Trackbase Analytics plugin for WordPress. Add your tracking ID and enable server-side crawler analytics in minutes.

    trackbase 10+ active installations Tested with 7.0.4

  • GlobeSign Content Markdown Mirror

    (0 total ratings)

    Makes your WordPress site AI-friendly: generates llms.txt and clean, structured Markdown mirrors of every page and post.

    globesign 10+ active installations Tested with 7.0.4

  • SEObot Monitor for Googlebot, Bingbot and search engine spiders

    (0 total ratings)

    With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …

    Santiago Alonso 10+ active installations Tested with 5.8.15

  • Page Modified

    (1 total ratings)

    Display the results of your Page Modified crawls right within your WordPress Admin.

    Chris Klosowski 10+ active installations Tested with 4.9.31

  • Crawl Hunt – Advanced SEO Optimization Tool

    (1 total ratings)

    A powerful website crawler and monitoring tool for WordPress.

    themeshopy 10+ active installations Tested with 7.0.4

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    bettoadami 10+ active installations Tested with 5.0.27

  • GoBookMart Robots Editor

    (1 total ratings)

    A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.

    Gobookmart 10+ active installations Tested with 6.9.7

  • JaspreetChahal’s wordpress bot detector lite

    (1 total ratings)

    This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …

    Jaspreet Chahal 10+ active installations Tested with 4.2.39

  • AI Crawler Guard

    (0 total ratings)

    Detect and control AI crawler access with local logging and history.

    aicrawlerguard.com Fewer than 10 active installations Tested with 6.9.7

  • BotObservatory – Live Bot Tracker & Anti-Scraper

    (1 total ratings)

    Observe human and machine traffic, identify suspicious automation, and optionally quarantine aggressive scrapers.

    traveliaq Fewer than 10 active installations Tested with 7.1

  • Virtual LLMS.TXT Generator

    (0 total ratings)

    Safely creates a virtual llms.txt dynamically. Features interactive bot targeting, map auto-syncing, and decoupled custom instructions.

    Alex Oreshkin Fewer than 10 active installations Tested with 7.0.4

  • URLs Most Wanted for LiteSpeed LScache

    (0 total ratings)

    A demand-driven sitemap for LiteSpeed Cache warmup. Record the URLs visitors actually use and warm only what people need.

    imedes Fewer than 10 active installations Tested with 7.1

  • Foundash AI Access Check

    (0 total ratings)

    Find out whether ChatGPT, Claude, Perplexity and Google's AI can actually read your website. Takes about ten seconds.

    boiledpotat0 Fewer than 10 active installations Tested with 7.1

  • Pixellize Site Issue Scanner

    (2 total ratings)

    Powerful SEO auditor by Pixellize. Crawls your site to fix broken links, missing meta tags, and unoptimized images.

    Pixellize Fewer than 10 active installations Tested with 7.1

  • Whizz MD — Markdown Endpoints for AI Crawlers

    (0 total ratings)

    Serve every WordPress post and page as a clean .md file with full SEO frontmatter — discoverable by AI crawlers and search engines on the fly.

    Whizz People Fewer than 10 active installations Tested with 7.0.4

  • FocusWeb AI Crawler Monitor – Track, Verify & Block AI Bots

    (0 total ratings)

    Track, verify and block AI crawlers (GPTBot, ClaudeBot, PerplexityBot). Spot spoofed bots, control robots.txt, measure AI referral traffic.

    Uri N. Fewer than 10 active installations Tested with 7.0.4

  • WEO LLMS & AI Crawler Guide

    (2 total ratings)

    The professional architect for your llms.txt file. Control how AI agents (ChatGPT, Claude, Perplexity) consume your website content with a structured, …

    Md Atiar Rahman Ovi Fewer than 10 active installations Tested with 6.9.7

  • Cleotic AI Traffic

    (0 total ratings)

    See AI crawler visits and AI assistant referrals on your site, with optional signed sync to Cleotic.

    cleotic Fewer than 10 active installations Tested with 7.0.4

  • Trimardeau SEO Log : SEO & GEO Bot Analytics

    (0 total ratings)

    SEO & GEO bot analytics: see Googlebot, ChatGPT, Claude and every AI crawler at work on each post, page and term — full crawl history included.

    Nicolas TRIMARDEAU Fewer than 10 active installations Tested with 7.1