abcxperts.com
robots.txt

Robots Exclusion Standard data for abcxperts.com

Resource Scan

Scan Details

Site Domain abcxperts.com
Base Domain abcxperts.com
Scan Status Ok
Last Scan2025-10-05T13:13:57+00:00
Next Scan 2025-10-12T13:13:57+00:00

Last Scan

Scanned2025-10-05T13:13:57+00:00
URL https://abcxperts.com/robots.txt
Domain IPs 104.16.172.24, 104.16.173.24
Response IP 104.16.172.24
Found Yes
Hash 6f85b05865b116fc11959752fb8d7e7d19f7d826abd5b181fdbddaeea5f6b9fa
SimHash 584cdc11ce90

Groups

*

Rule Path
Disallow /wp-content/uploads
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://abcxperts.com/sitemap_index.xml