gbebrokers.com
robots.txt

Robots Exclusion Standard data for gbebrokers.com

Resource Scan

Scan Details

Site Domain gbebrokers.com
Base Domain gbebrokers.com
Scan Status Ok
Last Scan2025-11-21T00:17:42+00:00
Next Scan 2025-12-21T00:17:42+00:00

Last Scan

Scanned2025-11-21T00:17:42+00:00
URL https://gbebrokers.com/robots.txt
Domain IPs 104.26.10.183, 104.26.11.183, 172.67.68.52, 2606:4700:20::681a:ab7, 2606:4700:20::681a:bb7, 2606:4700:20::ac43:4434
Response IP 172.67.68.52
Found Yes
Hash a8f742c42155139e610d74cee45fcd32a6a35a999ad96f392582d899d50a938d
SimHash 494cc800c0b3

Groups

*

Rule Path
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json

*

Rule Path
Disallow

oai-searchbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

gptbot

Rule Path
Allow /

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/
Disallow /wp-content/uploads/flags/
Disallow /documents/statistics/
Disallow /de/tag/
Disallow /de/category/

Other Records

Field Value
sitemap https://gbebrokers.com/sitemap_index.xml
sitemap https://www.gbebrokers.com/page-sitemap.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
  • START GBEBROKERS BLOCK
  • ---------------------------
  • ---------------------------
  • END GBEBROKERS BLOCK