mednet.co.il
robots.txt
Robots Exclusion Standard data for mednet.co.il
Resource Scan
Scan Details
Site Domain | mednet.co.il |
Base Domain | mednet.co.il |
Scan Status | Ok |
Last Scan | 2024-06-26T16:15:25+00:00 |
Next Scan | 2024-07-26T16:15:25+00:00 |
Last Scan
Scanned | 2024-06-26T16:15:25+00:00 |
URL | https://mednet.co.il/robots.txt |
Domain IPs | 104.26.10.100, 104.26.11.100, 172.67.68.108, 2606:4700:20::681a:a64, 2606:4700:20::681a:b64, 2606:4700:20::ac43:446c |
Response IP | 172.67.68.108 |
Found | Yes |
Hash | 06167c5b089cf44aae3114cbcab5765fba5d9dfdc712be20903616dace3980b8 |
SimHash | e245ccc8e639 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /wp-content/cache/ |
Disallow | /wp-content/uploads/ |
Disallow | /trackback/ |
Disallow | /feed/ |
Disallow | /comments/ |
Disallow | /landing/ |
Disallow | /preregister/ |
Disallow | /login/ |
Disallow | /member/ |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
Warnings
- 4 invalid lines.
Comments