superbgrade.com
robots.txt

Robots Exclusion Standard data for superbgrade.com

Resource Scan

Scan Details

Site Domain superbgrade.com
Base Domain superbgrade.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-19T05:46:36+00:00
Next Scan 2025-11-18T05:46:36+00:00

Last Successful Scan

Scanned2025-08-27T20:04:13+00:00
URL https://superbgrade.com/robots.txt
Domain IPs 104.21.20.105, 172.67.192.87, 2606:4700:3034::ac43:c057, 2606:4700:3036::6815:1469
Response IP 104.21.20.105
Found Yes
Hash b78e10cfbd289386ea1d95a5a57eea6a3a98ab16b4076bfedbe7d77510d93b2d
SimHash 214101b289b3

Groups

*

Rule Path
Disallow *feed
Disallow /*?rt
Disallow /*?discount
Disallow /reviews?page=
Allow /reviews$

Other Records

Field Value
sitemap https://superbgrade.com/sitemap.xml