bwebinternet.global
robots.txt

Robots Exclusion Standard data for bwebinternet.global

Resource Scan

Scan Details

Site Domain bwebinternet.global
Base Domain bwebinternet.global
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-08-14T06:26:55+00:00
Next Scan 2025-08-21T06:26:55+00:00

Last Successful Scan

Scanned2025-07-14T05:09:10+00:00
URL https://bwebinternet.global/robots.txt
Domain IPs 45.9.188.202
Response IP 45.9.188.202
Found Yes
Hash a6b9c5bccbcc0bda8253889109de9fede3232cedde53c04a9fbc6d6b30807486
SimHash c82cc8c0a093

Groups

*

Rule Path
Disallow

google-adsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Disallow /search/
Disallow /page/*/?s=

Other Records

Field Value
sitemap https://bwebinternet.global/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK