thepetlawfirm.com
robots.txt

Robots Exclusion Standard data for thepetlawfirm.com

Resource Scan

Scan Details

Site Domain thepetlawfirm.com
Base Domain thepetlawfirm.com
Scan Status Ok
Last Scan2025-05-01T06:36:22+00:00
Next Scan 2025-05-31T06:36:22+00:00

Last Scan

Scanned2025-05-01T06:36:22+00:00
URL https://thepetlawfirm.com/robots.txt
Redirect https://www.brandywinecarriagetours.com/robots.txt
Redirect Domain www.brandywinecarriagetours.com
Redirect Base brandywinecarriagetours.com
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.18.5, 172.67.179.29, 2606:4700:3032::ac43:b31d, 2606:4700:3033::6815:1205
Response IP 172.67.179.29
Found Yes
Hash 0f034581e1d8ae3c1536f052737b53e0b44811ddd1640c96815e046ec82b52a6
SimHash 6344dc524731

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.brandywinecarriagetours.com/sitemap.xml