brobible-com-develop.go-vip.net
robots.txt

Robots Exclusion Standard data for brobible-com-develop.go-vip.net

Resource Scan

Scan Details

Site Domain brobible-com-develop.go-vip.net
Base Domain go-vip.net
Scan Status Ok
Last Scan2024-11-09T16:22:03+00:00
Next Scan 2024-11-16T16:22:03+00:00

Last Scan

Scanned2024-11-09T16:22:03+00:00
URL https://brobible-com-develop.go-vip.net/robots.txt
Domain IPs 192.0.66.168, 2a04:fa87:fffd::c000:42a8
Response IP 192.0.66.168
Found Yes
Hash 7c073ff1c2c7669b5da294b318c3900152bb1bb419ab792d311b56542bdcfaac
SimHash 186058d1a8b2

Groups

*

Rule Path
Disallow /brofile/
Disallow /*/0/
Disallow /over-under/article/

*

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://brobible-com-develop.go-vip.net/news-sitemap.xml

Comments

  • Brobible Start
  • Brobible End
  • Crawling is blocked for go-vip.co and go-vip.net domains
  • ======Raptive Begin======
  • ======Raptive End======
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK