rsscockpit.com
robots.txt

Robots Exclusion Standard data for rsscockpit.com

Resource Scan

Scan Details

Site Domain rsscockpit.com
Base Domain rsscockpit.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-07-25T20:19:52+00:00
Next Scan 2025-10-23T20:19:52+00:00

Last Successful Scan

Scanned2024-12-28T09:15:30+00:00
URL https://rsscockpit.com/robots.txt
Domain IPs 104.21.57.188, 172.67.165.119, 2606:4700:3033::6815:39bc, 2606:4700:3036::ac43:a577
Response IP 104.21.57.188
Found Yes
Hash 4e21ccd0b1aa6c3a6c2d582ff241da1b0f32da3869a3b9919bbbf5a7e338f33d
SimHash 69551b52d7d1

Groups

*

Rule Path
Allow /
Disallow /facetsearch.do

googlebot

Rule Path
Disallow /facetsearch.do
Disallow /mobilenews.do
Disallow /tracker.jsp
Allow /

googlebot-mobile

Rule Path
Allow /
Disallow /facetsearch.do
Allow /mobilenews.do
Disallow /tracker.jsp

mediapartners-google*

Rule Path
Allow /facetsearch.do

adsbot-google

Rule Path
Allow /facetsearch.do

Other Records

Field Value
sitemap http://www.rsscockpit.com/sitemap.do?action=index