left.io
robots.txt

Robots Exclusion Standard data for left.io

Resource Scan

Scan Details

Site Domain left.io
Base Domain left.io
Scan Status Ok
Last Scan2024-06-09T18:15:13+00:00
Next Scan 2024-07-09T18:15:13+00:00

Last Scan

Scanned2024-06-09T18:15:13+00:00
URL https://left.io/robots.txt
Redirect https://www.travelai.com/robots.txt
Redirect Domain www.travelai.com
Redirect Base travelai.com
Domain IPs 3.165.82.102, 3.165.82.30, 3.165.82.4, 3.165.82.9
Redirect IPs 13.33.88.51, 13.33.88.55, 13.33.88.61, 13.33.88.9
Response IP 13.33.88.61
Found Yes
Hash 77ddad495e221e2da2a3b534fac700d7c0e9616e93efbe8619fb09cff3f87043
SimHash 7e3a4277fdb3

Groups

*

Rule Path
Disallow /api/
Disallow /creator-program

bubing
genieo
grapeshot
jamesbot
ltx71 - (http://ltx71.com/)
mj12bot
seznambot
dotbot
ccbot
tineye-bot
pubmatic crawler bot
mappydata
jooblebot
grapeshot
domainstatsbot
pubmaticcrawlerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cdn.travelai.com/site/sitemap.xml
sitemap https://www.travelai.com/resources/sitemap.xml