wheree.com
robots.txt

Robots Exclusion Standard data for wheree.com

Resource Scan

Scan Details

Site Domain wheree.com
Base Domain wheree.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan4/6/2025, 1:46:56 AM
Next Scan 7/5/2025, 1:46:56 AM

Last Successful Scan

Scanned9/9/2024, 1:37:52 AM
URL https://wheree.com/robots.txt
Redirect https://www.wheree.com/robots.txt
Redirect Domain www.wheree.com
Redirect Base wheree.com
Domain IPs 172.66.41.45, 172.66.42.211, 2606:4700:3108::ac42:292d, 2606:4700:3108::ac42:2ad3
Redirect IPs 172.66.41.45, 172.66.42.211, 2606:4700:3108::ac42:292d, 2606:4700:3108::ac42:2ad3
Response IP 172.66.42.211
Found Yes
Hash b109ad823b7b095351b3e7351109c13a80d40663bb01d145aa9984b9b53a94d7
SimHash c82504039283

Groups

petalbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

psbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

npbot-1/2.0

Rule Path
Disallow /

npbot

Rule Path
Disallow /

applebot
yandexdirect
*

Rule Path
Disallow /photos
Disallow /*page%3D
Disallow /?s=
Disallow /search/category-default
Disallow /favicon.ico
Disallow /wp-content/uploads/
Disallow /feed

Other Records

Field Value
sitemap https://www.wheree.com/site_index.xml

Comments

  • Hi there,
  • If you're sniffing around this file, and you're not a robot
  • Run - don't crawl - to apply to join Wheree's SEO team
  • Email info@wheree.com