steelsearcher.com
robots.txt
Robots Exclusion Standard data for steelsearcher.com
Resource Scan
Scan Details
| Site Domain | steelsearcher.com |
| Base Domain | steelsearcher.com |
| Scan Status | Ok |
| Last Scan | 2025-05-18T09:34:54+00:00 |
| Next Scan | 2025-06-17T09:34:54+00:00 |
Last Scan
| Scanned | 2025-05-18T09:34:54+00:00 |
| URL | https://steelsearcher.com/robots.txt |
| Redirect | https://www.steelsearcher.com/robots.txt |
| Redirect Domain | www.steelsearcher.com |
| Redirect Base | steelsearcher.com |
| Domain IPs | 47.254.20.223 |
| Redirect IPs | 47.254.20.223 |
| Response IP | 47.254.20.223 |
| Found | Yes |
| Hash | db5527f395e8f0174665a4815b18c857961cc2350fff6c7e0402088434155377 |
| SimHash | 9e24d45e99a3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /basic/* |
| Disallow | /840-internet-big-data-and--artificial-intelligence.html |
| Disallow | /833-basic/833e-commerce-platform.html |
| Disallow | /834-basic/834maximize-efficiency.html |
| Disallow | /835-basic/835supply-chain-finance.html |
| Disallow | /867-basic/867pid--866.html-heating.html |
| Disallow | /870-basic/870pid--866.html-cut.html |
| Disallow | /search-result-products.html |
| Disallow | /search-result-others.html |
| Disallow | /404.html |
| Disallow | /submission-successful.html |
| Disallow | /taggg.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.steelsearcher.com/sitemap.xml |