Log In Sign Up

itinemo.com
robots.txt

Robots Exclusion Standard data for itinemo.com

Resource Scan

Scan Details

Site Domain itinemo.com
Base Domain itinemo.com
Scan Status Ok
Last Scan2024-11-09T08:19:41+00:00
Next Scan 2024-11-16T08:19:41+00:00

Last Scan

Scanned2024-11-09T08:19:41+00:00
URL https://itinemo.com/robots.txt
Domain IPs 104.21.90.34, 172.67.193.201, 2606:4700:3034::6815:5a22, 2606:4700:3035::ac43:c1c9
Response IP 104.21.90.34
Found Yes
Hash da7ae7e5e0ab2a493d50636c9582001a2cde39a4e0713e355f2392fc5b2132fa
SimHash 7e1dd7437c93

Groups

butterfly

Rule Path
Disallow /

js-kit url resolver

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

postrank

Rule Path
Disallow /

qqdownload

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

tencenttraveler

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

voyager

Rule Path
Disallow /

wikiwix

Rule Path
Disallow /

yahoo pipes

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow

*

Rule Path
Disallow
Back to top

Comments

  • deny
  • restrict
  • allow
  • default (allow all)
Back to top