twitsozler.com
robots.txt
Robots Exclusion Standard data for twitsozler.com
Resource Scan
Scan Details
| Site Domain | twitsozler.com |
| Base Domain | twitsozler.com |
| Scan Status | Ok |
| Last Scan | 2024-09-23T09:06:53+00:00 |
| Next Scan | 2024-09-30T09:06:53+00:00 |
Last Scan
| Scanned | 2024-09-23T09:06:53+00:00 |
| URL | https://twitsozler.com/robots.txt |
| Domain IPs | 104.21.42.141, 172.67.162.128, 2606:4700:3031::ac43:a280, 2606:4700:3033::6815:2a8d |
| Response IP | 172.67.162.128 |
| Found | Yes |
| Hash | acbc6a9888acf4089c37821832f4bb591c90143f8a9f2216b617719c38ae35a6 |
| SimHash | 1c48f8202cb3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /news/ |
| Disallow | /tags/ |
| Disallow | /terms/about-us/ |
| Disallow | /terms/privacy-policy/ |
| Disallow | /terms/terms/ |
| Disallow | /login/ |
| Disallow | /register/ |
| Disallow | /news/ |
| Disallow | /edit-post/ |