Log In Sign Up

scanurl.me
robots.txt

Robots Exclusion Standard data for scanurl.me

Resource Scan

Scan Details

Site Domain scanurl.me
Base Domain scanurl.me
Scan Status Ok
Last Scan2025-03-12T01:39:15+00:00
Next Scan 2025-03-19T01:39:15+00:00

Last Scan

Scanned2025-03-12T01:39:15+00:00
URL https://scanurl.me/robots.txt
Domain IPs 104.21.13.179, 172.67.132.233, 2606:4700:3031::6815:db3, 2606:4700:3034::ac43:84e9
Response IP 172.67.132.233
Found Yes
Hash 97f60560c8b250ce0815f3a51a2faa44483769d81ae1d3f3c08b59685bb0904b
SimHash 691988448e92

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /core/
Back to top

Other Records

Field Value
sitemap https://www.scanurl.me/sitemap.xml
Back to top