usedprincerupert.com
robots.txt

Robots Exclusion Standard data for usedprincerupert.com

Resource Scan

Scan Details

Site Domain usedprincerupert.com
Base Domain usedprincerupert.com
Scan Status Ok
Last Scan2025-10-24T15:06:55+00:00
Next Scan 2025-10-31T15:06:55+00:00

Last Scan

Scanned2025-10-24T15:06:55+00:00
URL https://usedprincerupert.com/robots.txt
Domain IPs 104.21.91.106, 172.67.215.159, 2606:4700:3033::ac43:d79f, 2606:4700:3037::6815:5b6a
Response IP 172.67.215.159
Found Yes
Hash 84907e3e675c7fa2983a74e84c6b4c21bbce1f503c824639681419427005d2c1
SimHash 6814ccd077d3

Groups

googlebot

Rule Path
Disallow

googlebot-image
googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

google-extended

Rule Path
Allow /

Other Records

Field Value
sitemap https://usedprincerupert.com/sitemap.xml