widget.treatwell.es
robots.txt

Robots Exclusion Standard data for widget.treatwell.es

Resource Scan

Scan Details

Site Domain widget.treatwell.es
Base Domain treatwell.es
Scan Status Ok
Last Scan2025-03-03T15:59:38+00:00
Next Scan 2025-04-02T15:59:38+00:00

Last Scan

Scanned2025-03-03T15:59:38+00:00
URL https://widget.treatwell.es/robots.txt
Domain IPs 54.230.112.103, 54.230.112.39, 54.230.112.41, 54.230.112.68
Response IP 18.165.140.74
Found Yes
Hash 831e5176c8dfdee62ebfd0d4f06f9e6b88bad28e942ee7fcd6ab4ebd0333c83a
SimHash ed50d872c331

Groups

adsbot-google

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /
Disallow *weitere