Log In Sign Up

terp.ai
robots.txt

Robots Exclusion Standard data for terp.ai

Resource Scan

Scan Details

Site Domain terp.ai
Base Domain terp.ai
Scan Status Ok
Last Scan2025-06-14T00:46:22+00:00
Next Scan 2025-06-21T00:46:22+00:00

Last Scan

Scanned2025-06-14T00:46:22+00:00
URL https://www.terp.ai/robots.txt
Domain IPs 162.255.119.19, 2a09:8280:1::6:bf9d, 66.241.125.35
Response IP 66.241.125.35
Found Yes
Hash 1646cf6a998ae745d1e760090c6447644ac64966bf5bf160c49ea0dba115173c
SimHash 7d15dd056557

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandexbot

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap http://www.terp.ai/sitemap.xml
Back to top

Comments

  • Disallow all other bots
  • User-agent: *
  • Disallow: /
  • Add sitemap based on the domain
Back to top