scrapclare.com
robots.txt

Robots Exclusion Standard data for scrapclare.com

Resource Scan

Scan Details

Site Domain scrapclare.com
Base Domain scrapclare.com
Scan Status Ok
Last Scan2025-10-31T11:37:59+00:00
Next Scan 2025-11-07T11:37:59+00:00

Last Scan

Scanned2025-10-31T11:37:59+00:00
URL https://scrapclare.com/robots.txt
Domain IPs 104.26.12.99, 104.26.13.99, 172.67.74.195, 2606:4700:20::681a:c63, 2606:4700:20::681a:d63, 2606:4700:20::ac43:4ac3
Response IP 104.26.12.99
Found Yes
Hash 75325df0582e6a33d6e646ae4eb89f16b0bb585849c550f3b4aa07b1d742c72b
SimHash 88008020ef92

Groups

*

Rule Path
Allow *ads.txt$
Disallow