worldcatfinder.com
robots.txt

Robots Exclusion Standard data for worldcatfinder.com

Resource Scan

Scan Details

Site Domain worldcatfinder.com
Base Domain worldcatfinder.com
Scan Status Ok
Last Scan2024-11-16T05:41:56+00:00
Next Scan 2024-11-23T05:41:56+00:00

Last Scan

Scanned2024-11-16T05:41:56+00:00
URL https://worldcatfinder.com/robots.txt
Domain IPs 104.21.65.192, 172.67.165.124, 2606:4700:3033::ac43:a57c, 2606:4700:3034::6815:41c0
Response IP 172.67.165.124
Found Yes
Hash f39f63f315eba2ed9a49ae4080e95a6b08e3ef39cb5e3d3b48840f51b383dea7
SimHash 88015c248b12

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /admin

Other Records

Field Value
sitemap https://worldcatfinder.com/sitemap.xml