novostikartinaday.xyz
robots.txt
Robots Exclusion Standard data for novostikartinaday.xyz
Resource Scan
Scan Details
Site Domain | novostikartinaday.xyz |
Base Domain | novostikartinaday.xyz |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-09-21T14:52:53+00:00 |
Next Scan | 2024-09-28T14:52:53+00:00 |
Last Successful Scan
Scanned | 2024-05-23T11:30:29+00:00 |
URL | https://www.novostikartinaday.xyz/robots.txt |
Domain IPs | 104.21.57.176, 172.67.165.66, 2606:4700:3032::ac43:a542, 2606:4700:3034::6815:39b0 |
Response IP | 172.67.165.66 |
Found | Yes |
Hash | d4d379ad5bfe55c9e3b071665d1afd85f1adef0e7352f2e68a7b92a0442fc4b9 |
SimHash | 639777035de5 |
Groups
*
Rule | Path |
---|---|
Allow | /robots.txt |
Disallow | /*.js$ |
Disallow | /*.css$ |
Disallow | /*.css?* |
Disallow | /*.jpg$ |
Disallow | /*.jpeg$ |
Disallow | /*.png$ |
Disallow | /*.gif$ |
Disallow | /wp-content/ |
Disallow | /wp-includes/ |
Disallow | /temp/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.novostikartinaday.xyz/sitemap.xml |