slavneft.ru
robots.txt
Robots Exclusion Standard data for slavneft.ru
Resource Scan
Scan Details
Site Domain | slavneft.ru |
Base Domain | slavneft.ru |
Scan Status | Ok |
Last Scan | 2024-05-16T13:01:50+00:00 |
Next Scan | 2024-06-15T13:01:50+00:00 |
Last Scan
Scanned | 2024-05-16T13:01:50+00:00 |
URL | https://slavneft.ru/robots.txt |
Domain IPs | 194.84.59.6 |
Response IP | 194.84.59.6 |
Found | Yes |
Hash | f6adf80b34bc56ecf8494567fe56f8dfc1412b254b17af378b3d50e7465895a6 |
SimHash | d28eeb6267ab |
Groups
*
Rule | Path |
---|---|
Disallow | /_cache/ |
Disallow | /_cfg/ |
Disallow | /_cron/ |
Disallow | /_css/ |
Disallow | /_eng/ |
Disallow | /_form/ |
Disallow | /_i/ |
Disallow | /_import/ |
Disallow | /_inc/ |
Disallow | /_js/ |
Disallow | /_lightbox/ |
Disallow | /_log/ |
Disallow | /_module/ |
Disallow | /_nopub/ |
Disallow | /_tmp/ |
Disallow | /_xslt/ |
Disallow | /_eadmin/ |
Disallow | /_phpsf2/ |
Disallow | /search/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |