internetpoem.com
robots.txt
Robots Exclusion Standard data for internetpoem.com
Resource Scan
Scan Details
| Site Domain | internetpoem.com |
| Base Domain | internetpoem.com |
| Scan Status | Ok |
| Last Scan | 2024-09-28T01:10:06+00:00 |
| Next Scan | 2024-10-05T01:10:06+00:00 |
Last Scan
| Scanned | 2024-09-28T01:10:06+00:00 |
| URL | https://internetpoem.com/robots.txt |
| Domain IPs | 104.21.79.81, 172.67.169.93, 2606:4700:3034::6815:4f51, 2606:4700:3037::ac43:a95d |
| Response IP | 104.21.79.81 |
| Found | Yes |
| Hash | 194c0e2443ac543700fa313383402ae7e71114e11232d18abdb78aa49e84eef6 |
| SimHash | 8818fc50c601 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /login/ |
| Disallow | /login/* |
| Disallow | /login/*/ |
| Disallow | /login/*/* |
| Disallow | /login/*/*/ |
| Disallow | /login/*/*/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://internetpoem.com/sitemap.xml |