Log In Sign Up

isp-list.biz
robots.txt

Robots Exclusion Standard data for isp-list.biz

Resource Scan

Scan Details

Site Domain isp-list.biz
Base Domain isp-list.biz
Scan Status Ok
Last Scan2025-08-29T10:52:21+00:00
Next Scan 2025-09-05T10:52:21+00:00

Last Scan

Scanned2025-08-29T10:52:21+00:00
URL https://isp-list.biz/robots.txt
Domain IPs 104.21.35.83, 172.67.216.53, 2606:4700:3037::6815:2353, 2606:4700:3037::ac43:d835
Response IP 172.67.216.53
Found Yes
Hash 76ab584bf1b88550e93f13edd2d28095d3dbfe3e015f51c9fec6cc6a82df3c3c
SimHash aa7c91c20d91

Groups

mediapartners-google*

Rule Path
Disallow

yandex

Rule Path
Disallow /

*

Rule Path
Disallow /ThankYou.htm
Disallow /_derived/
Disallow /_private/
Disallow /_vti_bin/
Disallow /_vti_cnf/
Disallow /_vti_inf.html
Disallow /_vti_log/
Disallow /_vti_pvt/
Disallow /_vti_txt/
Disallow /data/
Disallow /fmdata/
Disallow /google7aceabd83d93aef6.html
Disallow /html/edt/
Disallow /html/imagefiles/
Disallow /postinfo.html

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://isp-list.biz/sitemap.xml
Back to top

Comments

  • Robot-Manager was used to generate this file.
  • Copyright (c) 2001-2002 by Sophtware.com, Inc. All Rights Reserved.
  • http://www.websitemanagementtools.com/
  • FULL access (Mediapartners-Google)
  • NO access (Yandex)
  • PARTIAL access (All Spiders)
Back to top