site123.com
robots.txt
Robots Exclusion Standard data for site123.com
Resource Scan
Scan Details
| Site Domain | site123.com |
| Base Domain | site123.com |
| Scan Status | Ok |
| Last Scan | 2024-06-01T13:40:58+00:00 |
| Next Scan | 2024-07-01T13:40:58+00:00 |
Last Scan
| Scanned | 2024-06-01T13:40:58+00:00 |
| URL | https://site123.com/robots.txt |
| Redirect | https://www.site123.com/robots.txt |
| Redirect Domain | www.site123.com |
| Redirect Base | site123.com |
| Domain IPs | 54.76.177.85 |
| Redirect IPs | 3.210.214.75, 3.220.208.202, 34.230.97.195, 72.44.51.118 |
| Response IP | 3.210.214.75 |
| Found | Yes |
| Hash | e0c199b16e7dfa8c63c6e8728082ddda89e8d1b877674871f92b77425f61e4da |
| SimHash | 224d52024193 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /manager/ |
| Disallow | /?w=* |
| Disallow | /?aff=* |
| Disallow | /?AFC=* |
| Disallow | /?changeLan=1 |
| Disallow | /?ref=steemhunt |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.site123.com/sitemap/secure_sitemap.xml |