dorriswedding.com
robots.txt

Robots Exclusion Standard data for dorriswedding.com

Resource Scan

Scan Details

Site Domain dorriswedding.com
Base Domain dorriswedding.com
Scan Status Ok
Last Scan2024-11-07T19:49:35+00:00
Next Scan 2024-12-07T19:49:35+00:00

Last Scan

Scanned2024-11-07T19:49:35+00:00
URL https://dorriswedding.com/robots.txt
Redirect https://www.dorriswedding.com/robots.txt
Redirect Domain www.dorriswedding.com
Redirect Base dorriswedding.com
Domain IPs 104.21.26.119, 172.67.168.70, 2606:4700:3031::6815:1a77, 2606:4700:3034::ac43:a846
Redirect IPs 13.35.238.104, 13.35.238.108, 13.35.238.117, 13.35.238.42, 2600:9000:2085:2800:1a:6e0b:36c0:93a1, 2600:9000:2085:3a00:1a:6e0b:36c0:93a1, 2600:9000:2085:7c00:1a:6e0b:36c0:93a1, 2600:9000:2085:a600:1a:6e0b:36c0:93a1, 2600:9000:2085:b000:1a:6e0b:36c0:93a1, 2600:9000:2085:bc00:1a:6e0b:36c0:93a1, 2600:9000:2085:be00:1a:6e0b:36c0:93a1, 2600:9000:2085:d800:1a:6e0b:36c0:93a1
Response IP 13.35.238.104
Found Yes
Hash 648eaaa4573d3d960d8c5c70b677431a32c5532c64de8f51b09f247349eecb4e
SimHash 6114c071f709

Groups

smtbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

daum

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

applebot

Rule Path
Disallow /

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

adsbot-google

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 6

*

Rule Path
Allow /
Disallow /articletype/
Disallow /comment/list/*
Allow /comment/list/$