mxtrainingblog.com
robots.txt

Robots Exclusion Standard data for mxtrainingblog.com

Resource Scan

Scan Details

Site Domain mxtrainingblog.com
Base Domain mxtrainingblog.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-25T08:42:19+00:00
Next Scan 2025-11-08T08:42:19+00:00

Last Successful Scan

Scanned2025-10-10T08:41:24+00:00
URL https://mxtrainingblog.com/robots.txt
Domain IPs 185.151.30.171, 2a07:7800::171
Response IP 185.151.30.171
Found Yes
Hash 012d9953ed8ae714f0b49a7dee3a814f9405e5b32f9b8feea9bfe61cf25bb342
SimHash 40384e60a6ba

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /xmlrpc.php
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /trackback/
Disallow /comments/
Disallow */trackback/
Disallow */feed/
Disallow */comments/
Allow /wp-admin/admin-ajax.php

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mxtrainingblog.com/sitemap_index.xml

Comments

  • Block SEO scrapers and resource-heavy bots