astroprovence.com
robots.txt
Robots Exclusion Standard data for astroprovence.com
Resource Scan
Scan Details
| Site Domain | astroprovence.com |
| Base Domain | astroprovence.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T12:10:01+00:00 |
| Next Scan | 2024-09-28T12:10:01+00:00 |
Last Scan
| Scanned | 2024-09-21T12:10:01+00:00 |
| URL | https://astroprovence.com/robots.txt |
| Domain IPs | 104.21.70.110, 172.67.223.17, 2606:4700:3035::6815:466e, 2606:4700:3036::ac43:df11 |
| Response IP | 172.67.223.17 |
| Found | Yes |
| Hash | 0c6e995778a0adb29f900335b15c33ac3a1d5cd91b94e7554672beaa8db1ea3b |
| SimHash | 7810f200e9c0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /404 |
| Disallow | /data-deletion |
| Disallow | /login |
| Disallow | /logout |
| Disallow | /goto |
| Disallow | /goto/ |
| Disallow | /search-article |
| Disallow | /search |
| Disallow | /tim-kiem/ |
| Disallow | /tim-kiem-truyen |
| Disallow | /w/ |
| Disallow | /wp-content/ |
| Disallow | /sw.js |