lynx.be
robots.txt
Robots Exclusion Standard data for lynx.be
Resource Scan
Scan Details
Site Domain | lynx.be |
Base Domain | lynx.be |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-17T05:14:23+00:00 |
Next Scan | 2024-11-16T05:14:23+00:00 |
Last Successful Scan
Scanned | 2024-07-17T01:41:27+00:00 |
URL | https://lynx.be/robots.txt |
Redirect | https://www.lynx.be/robots.txt |
Redirect Domain | www.lynx.be |
Redirect Base | lynx.be |
Domain IPs | 108.157.254.53, 108.157.254.61, 108.157.254.84, 108.157.254.93 |
Redirect IPs | 108.157.254.53, 108.157.254.61, 108.157.254.84, 108.157.254.93 |
Response IP | 108.157.254.84 |
Found | Yes |
Hash | e2558ee0eca7408d977562ff907e7f480ec34ee620a4b1919d0e46b5da6b1828 |
SimHash | e90d5c008db2 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /zoeken/ |
Disallow | /wp/wp-admin/ |
Disallow | /media/ebooks/succesvol_beleggen_met_opties.pdf |
Disallow | /media/*.xml$ |
Disallow | /app/uploads/*.xml$ |
Disallow | /*/amp/* |
Disallow | /*?amp |
Disallow | /*iframe_disclaimer |
Disallow | /*disclaimer_post_id |
Disallow | /*iframe/disclaimer |
Disallow | /media/doc/basisovereenkomst.pdf |
Other Records
Field | Value |
---|---|
sitemap | https://www.lynx.be/sitemap_index.xml |