Log In Sign Up

sstore.ng
robots.txt

Robots Exclusion Standard data for sstore.ng

Resource Scan

Scan Details

Site Domain sstore.ng
Base Domain sstore.ng
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan3/16/2025, 9:00:26 AM
Next Scan 4/15/2025, 9:00:26 AM

Last Successful Scan

Scanned2/15/2025, 8:59:44 AM
URL https://www.sstore.ng/robots.txt
Redirect http://www.sstore.ng/robots.txt
Domain IPs 104.21.42.161, 172.67.163.136, 2606:4700:3035::6815:2aa1, 2606:4700:3037::ac43:a388
Response IP 104.21.42.161
Found Yes
Hash 439619165cd7b1ee56f19d8d22fe51c577dd40e74758827a8215eaaa1ba5e798
SimHash 60161959ce06

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow /private/

*

Rule Path
Allow /public-directory/
Back to top

Other Records

Field Value
sitemap https://sstore.ng/site-map.xml
Back to top

Comments

  • Allow all crawlers access to everything
  • Specific rules for a specific crawler (e.g., Googlebot)
  • Allow access to a specific directory for all crawlers
  • Specify the location of your sitemap
Back to top