octalsteel.com
robots.txt
Robots Exclusion Standard data for octalsteel.com
Resource Scan
Scan Details
Site Domain | octalsteel.com |
Base Domain | octalsteel.com |
Scan Status | Ok |
Last Scan | 2025-03-22T06:20:38+00:00 |
Next Scan | 2025-04-21T06:20:38+00:00 |
Last Scan
Scanned | 2025-03-22T06:20:38+00:00 |
URL | https://octalsteel.com/robots.txt |
Domain IPs | 104.26.12.195, 104.26.13.195, 172.67.74.250, 2606:4700:20::681a:cc3, 2606:4700:20::681a:dc3, 2606:4700:20::ac43:4afa |
Response IP | 172.67.74.250 |
Found | Yes |
Hash | 5b6d0b700b566ab672fda6915d8e2fa3b12901521520504fc75c8ca1bfb820ef |
SimHash | e5208bc572b5 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /wp-admin$ |
Disallow | /wp-admin*/ |
Disallow | /author/admin$ |
Disallow | /author/admin/ |
Disallow | /archives$ |
Disallow | /archives/ |
Disallow | /page/ |
Disallow | /page/* |
Disallow | /*/page/ |
Disallow | /*/page/* |
Disallow | /tag%26 |
Disallow | /tag/ |
Disallow | /tag/* |
Disallow | /comments/feed |
Disallow | /comments/feed/ |
Disallow | /xmlrpc.php$ |
Disallow | */trackback/ |
Disallow | /*?s=* |
Disallow | /*?replytocom |
Allow | /*.js |
Allow | /*.css |
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /wp-admin$ |
Disallow | /wp-admin*/ |
Disallow | /author/admin$ |
Disallow | /author/admin/ |
Disallow | /archives$ |
Disallow | /archives/ |
Disallow | /page/ |
Disallow | /page/* |
Disallow | /*/page/ |
Disallow | /*/page/* |
Disallow | /tag%26 |
Disallow | /tag/ |
Disallow | /tag/* |
Disallow | /comments/feed |
Disallow | /comments/feed/ |
Disallow | /xmlrpc.php$ |
Disallow | */trackback/ |
Disallow | /*?s=* |
Disallow | /*?replytocom |
Allow | /*.js |
Allow | /*.css |
Other Records
Field | Value |
---|---|
sitemap | http://www.octalsteel.com/sitemap.xml |
Warnings
- 4 invalid lines.