costaandsierra.com
robots.txt

Robots Exclusion Standard data for costaandsierra.com

Resource Scan

Scan Details

Site Domain costaandsierra.com
Base Domain costaandsierra.com
Scan Status Ok
Last Scan2024-05-21T11:59:29+00:00
Next Scan 2024-05-28T11:59:29+00:00

Last Scan

Scanned2024-05-21T11:59:29+00:00
URL https://costaandsierra.com/robots.txt
Domain IPs 69.27.124.220
Response IP 69.27.124.220
Found Yes
Hash 97eb7ad647298e76b049612596960ac5d1985458b7a9e7ad4a7d85406dcb6661
SimHash 017a9a534c91

Groups

*

Rule Path
Disallow /emails/
Disallow /mail/
Disallow /confirm/

sbider

Rule Path
Disallow /

e-societyrobot

Rule Path
Disallow /

szukacz

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

snapbot

Rule Path
Disallow /

geniebot

Rule Path
Disallow /

exabot-images

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

openbot

Rule Path
Disallow /

nimblecrawler

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

converacrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

girafabot

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

henrythemiragorobot

Rule Path
Disallow /

activetouristbot

Rule Path
Disallow /

localcombot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

mqbot

Rule Path
Disallow /

factbot

Rule Path
Disallow /

depspid

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /