directferries.es
robots.txt
Robots Exclusion Standard data for directferries.es
Resource Scan
Scan Details
Site Domain | directferries.es |
Base Domain | directferries.es |
Scan Status | Ok |
Last Scan | 2024-10-18T02:16:10+00:00 |
Next Scan | 2024-11-17T02:16:10+00:00 |
Last Scan
Scanned | 2024-10-18T02:16:10+00:00 |
URL | https://directferries.es/robots.txt |
Redirect | https://www.directferries.es/robots.txt |
Redirect Domain | www.directferries.es |
Redirect Base | directferries.es |
Domain IPs | 65.9.112.106, 65.9.112.39, 65.9.112.53, 65.9.112.6 |
Redirect IPs | 65.9.112.106, 65.9.112.39, 65.9.112.53, 65.9.112.6 |
Response IP | 65.9.112.6 |
Found | Yes |
Hash | cd4b6148d1fe113ff49ebbfef026b5e79b24057578ae8d824ad03bb79216a748 |
SimHash | 41450f4fa5d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /besr/ |
Disallow | /shipreviews/ |
Disallow | /pof/ |
Disallow | *?showrevs= |
Disallow | *?gourl= |
Disallow | *?showdesktop= |
Disallow | *?dfgeoo= |
Disallow | *?dtef= |
Disallow | *?dfpid= |
Disallow | *?utm_source= |
Other Records
Field | Value |
---|---|
sitemap | https://www.directferries.es/sitemap.xml |
Comments