travelgay.gr
robots.txt

Robots Exclusion Standard data for travelgay.gr

Resource Scan

Scan Details

Site Domain travelgay.gr
Base Domain travelgay.gr
Scan Status Ok
Last Scan2024-10-03T08:57:24+00:00
Next Scan 2024-10-10T08:57:24+00:00

Last Scan

Scanned2024-10-03T08:57:24+00:00
URL https://travelgay.gr/robots.txt
Redirect https://www.travelgay.gr/robots.txt
Redirect Domain www.travelgay.gr
Redirect Base travelgay.gr
Domain IPs 54.38.227.216
Redirect IPs 54.38.227.216
Response IP 54.38.227.216
Found Yes
Hash 051e0dabcb4a56d5fdf0becfc980bd51dacaaa86b06155919a18c13f59fc3749
SimHash 6f049c45e7f2

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.travelgay.gr/sitemap.xml