Log In Sign Up

liquidweb.com
robots.txt

Robots Exclusion Standard data for liquidweb.com

Resource Scan

Scan Details

Site Domain liquidweb.com
Base Domain liquidweb.com
Scan Status Ok
Last Scan2024-10-20T07:44:35+00:00
Next Scan 2024-11-19T07:44:35+00:00

Last Scan

Scanned2024-10-20T07:44:35+00:00
URL https://liquidweb.com/robots.txt
Redirect https://www.liquidweb.com/robots.txt
Redirect Domain www.liquidweb.com
Redirect Base liquidweb.com
Domain IPs 172.66.40.120, 172.66.43.136, 2606:4700:3108::ac42:2878, 2606:4700:3108::ac42:2b88
Redirect IPs 172.66.40.120, 172.66.43.136, 2606:4700:3108::ac42:2878, 2606:4700:3108::ac42:2b88
Response IP 172.66.43.136
Found Yes
Hash 74e74602e36c6b179d063006e4f8fd7d3288b102e217da158d0e65dbd061c572
SimHash 78269e8c0bf2

Groups

*

Rule Path
Disallow /search/
Disallow /wp-admin/
Disallow /xmlrpc.php
Disallow /*.pdf
Disallow /sso/
Disallow /delegate-www.html
Disallow /bingsiteauth.xml
Disallow /rigor/

nerdybot

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.liquidweb.com/sitemap_index.xml
Back to top

Comments

  • robots.txt for https://www.liquidweb.com/
  • 1 July 2024
  • Greetings human user.
  • This is robot territory.
  • To learn more about our hosting visit www.liquidweb.com/
  • Misc pages
  • NerdyBot for Nerdy Data dotcom
  • Dugg content scraper
Back to top