beztabu.net
robots.txt

Robots Exclusion Standard data for beztabu.net

Resource Scan

Scan Details

Site Domain beztabu.net
Base Domain beztabu.net
Scan Status Ok
Last Scan2024-09-20T06:35:54+00:00
Next Scan 2024-09-27T06:35:54+00:00

Last Scan

Scanned2024-09-20T06:35:54+00:00
URL https://beztabu.net/robots.txt
Domain IPs 104.26.4.162, 104.26.5.162, 172.67.69.74, 2606:4700:20::681a:4a2, 2606:4700:20::681a:5a2, 2606:4700:20::ac43:454a
Response IP 104.26.5.162
Found Yes
Hash 46f20a7663976be2e8f2071269cbdfa12e4019d7600e0444c0f8a05e3a66e535
SimHash 434482620fb3

Groups

*

Rule Path
Allow /
Disallow /56301415/
Disallow /113579682/

yandex

Rule Path
Allow /
Disallow /56301415/
Disallow /113579682/
Disallow /*amp

Other Records

Field Value
sitemap https://beztabu.net/sitemapindex.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449

Warnings

  • `host` is not a known field.