sidebysidestuff.com
robots.txt
Robots Exclusion Standard data for sidebysidestuff.com
Resource Scan
Scan Details
Site Domain | sidebysidestuff.com |
Base Domain | sidebysidestuff.com |
Scan Status | Ok |
Last Scan | 2025-08-25T14:59:56+00:00 |
Next Scan | 2025-09-24T14:59:56+00:00 |
Last Scan
Scanned | 2025-08-25T14:59:56+00:00 |
URL | https://sidebysidestuff.com/robots.txt |
Domain IPs | 104.26.6.49, 104.26.7.49, 172.67.68.84, 2606:4700:20::681a:631, 2606:4700:20::681a:731, 2606:4700:20::ac43:4454 |
Response IP | 104.26.7.49 |
Found | Yes |
Hash | 0776e82d3442aada83b07a9019d416efe1709022678dd3645cde3db3fdf60700 |
SimHash | 6c34254dcdb1 |
Groups
*
Rule | Path |
---|---|
Disallow | */404.html |
Disallow | */ind.html |
Disallow | */norder.html |
Disallow | */notify-catalog.html |
Disallow | */nsearch.html |
Disallow | */searchresults.html |
Disallow | /*/cgi-bin/ |
Disallow | /OS/ |
Disallow | /P/ |
Disallow | /QS/ |
Disallow | /RT/ |
Disallow | /TG/ |
Disallow | /bt%3D |
Disallow | /cgi-bin/ |
Disallow | /cgi-bin/refsd?* |
Disallow | /cs/ |
Disallow | /en%3D |
Disallow | /ii%3D |
Disallow | /io%3D |
Disallow | /p/s%3D |
Disallow | /sid%3D |
Disallow | /wgl/ |
Disallow | /ymix/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.sidebysidestuff.com/sitemap.xml |