Log In Sign Up

autot.tori.fi
robots.txt

Robots Exclusion Standard data for autot.tori.fi

Resource Scan

Scan Details

Site Domain autot.tori.fi
Base Domain tori.fi
Scan Status Ok
Last Scan2024-04-25T07:18:24+00:00
Next Scan 2024-05-25T07:18:24+00:00

Last Scan

Scanned2024-04-25T07:18:24+00:00
URL https://autot.tori.fi/robots.txt
Domain IPs 13.227.74.117, 13.227.74.39, 13.227.74.54, 13.227.74.7
Response IP 18.165.171.27
Found Yes
Hash 019a56b1fa5db7e33c68712a81c5ecaceb323d601eafa777b4b278d493a62f7e
SimHash e9395514cbe7

Groups

ia_archiver

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

*

Rule Path
Disallow /api/
Disallow /embed/
Back to top

Other Records

Field Value
sitemap https://autot.tori.fi/sitemap_index.xml
Back to top

Comments

  • It is expressly forbidden to use spiders or other
  • automated methods to access tori.fi. Only if tori.fi
  • has given special permit such access is allowed.
  • Archive.org
  • theTradeDesk
  • Disallow certain routes
Back to top