u-trail.com
robots.txt

Robots Exclusion Standard data for u-trail.com

Resource Scan

Scan Details

Site Domain u-trail.com
Base Domain u-trail.com
Scan Status Ok
Last Scan2024-09-21T03:38:51+00:00
Next Scan 2024-09-28T03:38:51+00:00

Last Scan

Scanned2024-09-21T03:38:51+00:00
URL https://u-trail.com/robots.txt
Redirect https://www.u-trail.com/robots.txt
Redirect Domain www.u-trail.com
Redirect Base u-trail.com
Domain IPs 178.79.131.229, 178.79.139.73
Redirect IPs 178.79.131.229, 178.79.139.73
Response IP 178.79.131.229
Found Yes
Hash 53d63f38cc5a974ccfd5eeb7c76d6c4e50a0bc7d532f16a445216edebbaee3e3
SimHash 6a40d8114335

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10