site123.com
robots.txt
Robots Exclusion Standard data for site123.com
Resource Scan
Scan Details
| Site Domain | site123.com |
| Base Domain | site123.com |
| Scan Status | Ok |
| Last Scan | 2024-10-29T13:42:33+00:00 |
| Next Scan | 2024-11-28T13:42:33+00:00 |
Last Scan
| Scanned | 2024-10-29T13:42:33+00:00 |
| URL | https://site123.com/robots.txt |
| Redirect | https://www.site123.com/robots.txt |
| Redirect Domain | www.site123.com |
| Redirect Base | site123.com |
| Domain IPs | 54.76.177.85 |
| Redirect IPs | 3.213.25.133, 34.205.119.161, 52.0.183.253, 54.156.174.197 |
| Response IP | 34.205.119.161 |
| Found | Yes |
| Hash | e0c199b16e7dfa8c63c6e8728082ddda89e8d1b877674871f92b77425f61e4da |
| SimHash | 224d52024193 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /manager/ |
| Disallow | /?w=* |
| Disallow | /?aff=* |
| Disallow | /?AFC=* |
| Disallow | /?changeLan=1 |
| Disallow | /?ref=steemhunt |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.site123.com/sitemap/secure_sitemap.xml |