scrapvendor.com
robots.txt

Robots Exclusion Standard data for scrapvendor.com

Resource Scan

Scan Details

Site Domain scrapvendor.com
Base Domain scrapvendor.com
Scan Status Ok
Last Scan2025-11-04T02:50:53+00:00
Next Scan 2025-12-04T02:50:53+00:00

Last Scan

Scanned2025-11-04T02:50:53+00:00
URL https://scrapvendor.com/robots.txt
Domain IPs 103.21.59.198
Response IP 103.21.59.198
Found Yes
Hash dfd74ff887f65a5da020af8f593d53da5c30fd32942c2507a503658a6e077ef1
SimHash 690058400db3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://scrapvendor.com/sitemap.xml