m.dorriswedding.com
robots.txt

Robots Exclusion Standard data for m.dorriswedding.com

Resource Scan

Scan Details

Site Domain m.dorriswedding.com
Base Domain dorriswedding.com
Scan Status Ok
Last Scan2024-11-03T08:15:04+00:00
Next Scan 2024-12-03T08:15:04+00:00

Last Scan

Scanned2024-11-03T08:15:04+00:00
URL https://m.dorriswedding.com/robots.txt
Domain IPs 13.225.4.15, 13.225.4.25, 13.225.4.29, 13.225.4.62, 2600:9000:21b4:1200:1f:2b62:2440:93a1, 2600:9000:21b4:3c00:1f:2b62:2440:93a1, 2600:9000:21b4:5200:1f:2b62:2440:93a1, 2600:9000:21b4:ac00:1f:2b62:2440:93a1, 2600:9000:21b4:b400:1f:2b62:2440:93a1, 2600:9000:21b4:bc00:1f:2b62:2440:93a1, 2600:9000:21b4:c600:1f:2b62:2440:93a1, 2600:9000:21b4:d600:1f:2b62:2440:93a1
Response IP 13.225.4.29
Found Yes
Hash 648eaaa4573d3d960d8c5c70b677431a32c5532c64de8f51b09f247349eecb4e
SimHash 6114c071f709

Groups

smtbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

daum

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

applebot

Rule Path
Disallow /

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

adsbot-google

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 6

*

Rule Path
Allow /
Disallow /articletype/
Disallow /comment/list/*
Allow /comment/list/$