Log In Sign Up

regionaldirectory.biz
robots.txt

Robots Exclusion Standard data for regionaldirectory.biz

Resource Scan

Scan Details

Site Domain regionaldirectory.biz
Base Domain regionaldirectory.biz
Scan Status Ok
Last Scan2025-03-28T22:04:59+00:00
Next Scan 2025-04-04T22:04:59+00:00

Last Scan

Scanned2025-03-28T22:04:59+00:00
URL https://regionaldirectory.biz/robots.txt
Domain IPs 104.21.50.226, 172.67.167.166, 2606:4700:3031::6815:32e2, 2606:4700:3034::ac43:a7a6
Response IP 172.67.167.166
Found Yes
Hash e3089bedfff3d44e079c6693dbd76cf8d4ebefe493a26909763a0a4e6a541ec6
SimHash aa1599c21d91

Groups

mediapartners-google*

Rule Path
Disallow

yandex

Rule Path
Disallow /

*

Rule Path
Disallow /_private/
Disallow /_vti_bin/
Disallow /_vti_cnf/
Disallow /_vti_inf.html
Disallow /_vti_log/
Disallow /_vti_pvt/
Disallow /_vti_txt/
Disallow /data/
Disallow /data_m/
Disallow /images/
Disallow /postinfo.html

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.regionaldirectory.biz/sitemap.xml
Back to top

Comments

  • Robot-Manager was used to generate this file.
  • Copyright (c) 2001-2002 by Sophtware.com, Inc. All Rights Reserved.
  • http://www.websitemanagementtools.com/
  • FULL access (Mediapartners-Google)
  • NO access (Yandex)
  • PARTIAL access (All Spiders)
Back to top