widget.treatwell.fr
robots.txt

Robots Exclusion Standard data for widget.treatwell.fr

Resource Scan

Scan Details

Site Domain widget.treatwell.fr
Base Domain treatwell.fr
Scan Status Ok
Last Scan2025-03-03T20:19:54+00:00
Next Scan 2025-04-02T20:19:54+00:00

Last Scan

Scanned2025-03-03T20:19:54+00:00
URL https://widget.treatwell.fr/robots.txt
Domain IPs 13.226.2.105, 13.226.2.115, 13.226.2.20, 13.226.2.91
Response IP 18.165.140.74
Found Yes
Hash 831e5176c8dfdee62ebfd0d4f06f9e6b88bad28e942ee7fcd6ab4ebd0333c83a
SimHash ed50d872c331

Groups

adsbot-google

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /
Disallow *weitere