Log In Sign Up

wecasa.co.uk
robots.txt

Robots Exclusion Standard data for wecasa.co.uk

Resource Scan

Scan Details

Site Domain wecasa.co.uk
Base Domain wecasa.co.uk
Scan Status Ok
Last Scan2025-10-29T18:32:00+00:00
Next Scan 2025-11-12T18:32:00+00:00

Last Scan

Scanned2025-10-29T18:32:00+00:00
URL https://wecasa.co.uk/robots.txt
Redirect https://www.wecasa.co.uk/robots.txt
Redirect Domain www.wecasa.co.uk
Redirect Base wecasa.co.uk
Domain IPs 2600:9000:26a2:1800:e:58bc:5040:93a1, 2600:9000:26a2:600:e:58bc:5040:93a1, 2600:9000:26a2:6600:e:58bc:5040:93a1, 2600:9000:26a2:8200:e:58bc:5040:93a1, 2600:9000:26a2:8400:e:58bc:5040:93a1, 2600:9000:26a2:9c00:e:58bc:5040:93a1, 2600:9000:26a2:cc00:e:58bc:5040:93a1, 2600:9000:26a2:fe00:e:58bc:5040:93a1, 3.165.255.13, 3.165.255.68, 3.165.255.74, 3.165.255.87
Redirect IPs 104.26.6.4, 104.26.7.4, 172.67.74.124, 2606:4700:20::681a:604, 2606:4700:20::681a:704, 2606:4700:20::ac43:4a7c
Response IP 104.26.7.4
Found Yes
Hash ad35b3aac5ae3e4ac3ca85e9748fa089f12b4c3e56ff3faf407ffeb6217d1d4c
SimHash 9a948d857440

Groups

facebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

indeedbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.wecasa.co.uk/sitemaps/en-gb/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
  • Facebook bot crawlers
  • Facebook bot crawlers
  • Indeed bot crawlers
  • Commercial SEO Professional Crawler
  • Commercial SEO Professional Crawler
Back to top