adoptananimalkits.com
robots.txt

Robots Exclusion Standard data for adoptananimalkits.com

Resource Scan

Scan Details

Site Domain adoptananimalkits.com
Base Domain adoptananimalkits.com
Scan Status Ok
Last Scan2025-11-30T17:48:31+00:00
Next Scan 2025-12-30T17:48:31+00:00

Last Scan

Scanned2025-11-30T17:48:31+00:00
URL https://adoptananimalkits.com/robots.txt
Redirect https://www.adoptananimalkits.com/robots.txt
Redirect Domain www.adoptananimalkits.com
Redirect Base adoptananimalkits.com
Domain IPs 104.21.86.21, 172.67.214.54, 2606:4700:3030::ac43:d636, 2606:4700:3034::6815:5615
Redirect IPs 104.21.86.21, 172.67.214.54, 2606:4700:3030::ac43:d636, 2606:4700:3034::6815:5615
Response IP 172.67.214.54
Found Yes
Hash 5f1acbeac88ede02e4de2d4783384f1a0a35431fdfed6c45bcaace68ea15776e
SimHash 69489850e533

Groups

googlebot

Rule Path
Allow /

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.adoptananimalkits.com/sitemap.xml