storia.ro
robots.txt
Robots Exclusion Standard data for storia.ro
Resource Scan
Scan Details
| Site Domain | storia.ro |
| Base Domain | storia.ro |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-02T19:02:11+00:00 |
| Next Scan | 2024-11-16T19:02:11+00:00 |
Last Successful Scan
| Scanned | 2024-10-04T14:57:43+00:00 |
| URL | https://storia.ro/robots.txt |
| Redirect | https://www.storia.ro:443/robots.txt |
| Redirect Domain | www.storia.ro |
| Redirect Base | storia.ro |
| Domain IPs | 75.2.8.141 |
| Redirect IPs | 65.9.112.111, 65.9.112.53, 65.9.112.78, 65.9.112.8 |
| Response IP | 18.165.122.12 |
| Found | Yes |
| Hash | 23521eb7be8d529cda0be6c082aa851d57448f2c1cc4c7ee8d4af7b520ac8bea |
| SimHash | d315ca300f39 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /adminpanel/ |
| Disallow | /ro/login |
| Disallow | /adprint/ |
| Disallow | /oferta/contact/ |
| Disallow | /plata/ |
| Disallow | /anunt-nou/confirm/ |
| Disallow | /anunt-nou/confirmpage/ |
| Disallow | /i2/oferta/abuse/ |
| Disallow | /m/oferta/abuse/ |
| Disallow | /changelang/ |
| Disallow | /*Listing-HalfPage-Rectangle |
| Disallow | /*Listing-Rectangle |
| Disallow | /*Listing-FooterBillboard |
| Disallow | /*Listing-Skyscraper |
| Disallow | /*AdPage-Rectangle |
| Disallow | /*AdPage-Billboard |
| Disallow | /*HalfPage-Rectangle |
| Disallow | /*AdPage-TextlinkTop |
| Disallow | /*AdPage-TextlinkBottom |
| Disallow | /*AdPageMobile |
| Disallow | /*AdPage/Halfpage |
| Disallow | /*AdPage/BoxGallery |
| Disallow | /*AdPage/TextAd |
| Disallow | /*AdPage/AdditionalBoxGallery |
| Disallow | /*Listing/Billboard |
| Disallow | /*Listing/AdditionalBox |
| Disallow | /*Listing/Skyscraper |
| Disallow | /*Listing/Rectangle |
| Disallow | /*AdPage/Billboard |
| Disallow | /*Mobile/BoxGallery |
| Disallow | /*?*map=1 |
| Disallow | /*description%3D%7Bsearch_term_string%7D |
| Disallow | /api/query |
| Allow | /api/query?crawl=true |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.storia.ro/sitemap.xml |
| sitemap | https://www.storia.ro/blog/sitemap.xml |
Warnings
- `host` is not a known field.