itnewz.ro
robots.txt
Robots Exclusion Standard data for itnewz.ro
Resource Scan
Scan Details
Site Domain | itnewz.ro |
Base Domain | itnewz.ro |
Scan Status | Ok |
Last Scan | 2024-09-28T05:05:57+00:00 |
Next Scan | 2024-10-05T05:05:57+00:00 |
Last Scan
Scanned | 2024-09-28T05:05:57+00:00 |
URL | https://itnewz.ro/robots.txt |
Redirect | https://www.itnewz.ro/robots.txt |
Redirect Domain | www.itnewz.ro |
Redirect Base | itnewz.ro |
Domain IPs | 89.41.38.21 |
Redirect IPs | 89.41.38.21 |
Response IP | 89.41.38.21 |
Found | Yes |
Hash | 910ce579e05b0df5394253bffea36e7ef621bc72136065f31d1b1c35ee5ee5ab |
SimHash | 2142d022f2f7 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /trackback |
Disallow | /comments |
Disallow | */trackback |
Disallow | */comments |
Other Records
Field | Value |
---|---|
sitemap | https://www.itnewz.ro/sitemap_index.xml |
Comments