rsbnetwork.com
robots.txt

Robots Exclusion Standard data for rsbnetwork.com

Resource Scan

Scan Details

Site Domain rsbnetwork.com
Base Domain rsbnetwork.com
Scan Status Ok
Last Scan2024-11-09T20:54:17+00:00
Next Scan 2024-11-16T20:54:17+00:00

Last Scan

Scanned2024-11-09T20:54:17+00:00
URL https://rsbnetwork.com/robots.txt
Domain IPs 104.22.78.140, 104.22.79.140, 172.67.42.250, 2606:4700:10::6816:4e8c, 2606:4700:10::6816:4f8c, 2606:4700:10::ac43:2afa
Response IP 172.67.42.250
Found Yes
Hash d7b5b05e468cfed13c51febcaa083c2309b2265791fab8aed518b251277cfa3e
SimHash b85cd22068d3

Groups

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

*

Rule Path
Disallow /*.gif$
Disallow /*.Gif$
Disallow /*.GIF$
Disallow /*.pdf$
Disallow /*.Pdf$
Disallow /*.PDF$
Disallow /*.zip$
Disallow /*.Zip$
Disallow /*.ZIP$

Warnings

  • 2 invalid lines.