rsgs.org
robots.txt

Robots Exclusion Standard data for rsgs.org

Resource Scan

Scan Details

Site Domain rsgs.org
Base Domain rsgs.org
Scan Status Ok
Last Scan2024-05-24T16:20:09+00:00
Next Scan 2024-06-23T16:20:09+00:00

Last Scan

Scanned2024-05-24T16:20:09+00:00
URL https://rsgs.org/robots.txt
Redirect https://www.rsgs.org/robots.txt
Redirect Domain www.rsgs.org
Redirect Base rsgs.org
Domain IPs 18.194.96.163
Redirect IPs 104.17.92.94, 104.17.93.94, 104.17.94.94, 104.17.95.94, 104.17.96.94, 2606:4700::6811:5c5e, 2606:4700::6811:5d5e, 2606:4700::6811:5e5e, 2606:4700::6811:5f5e, 2606:4700::6811:605e
Response IP 104.17.94.94
Found Yes
Hash 0f1806dfb9c67cdcbec7219ed07fd7353c6a539ca33d76b1c509ea7a249caba3
SimHash c210f032e4f3

Groups

*

Rule Path
Disallow /payments/donate

*

Rule Path
Disallow /getimage.aspx
Disallow /images/*/cropped
Disallow /pages/postcounter.aspx
Disallow /pages/search.aspx
Disallow /Pages/Search.aspx
Disallow /services/
Disallow /Services/
Disallow /Pages/DisplayNot.aspx
Disallow /lobby/
Disallow /Lobby/
Disallow /handlers/
Disallow /Handlers/
Disallow /Handlers/Download.ashx
Disallow /login
Disallow /Login
Disallow /pages/payment/complete.aspx
Disallow /BaseUI/v2_4/Handlers/

dotbot

Rule Path
Disallow /

twitterbot
facebookexternalhit
facebookexternalhit/1.1
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
facebot

Rule Path
Allow /handlers/getimage.ashx

Other Records

Field Value
sitemap https://www.rsgs.org/sitemap.xml