ferrero.nl
robots.txt
Robots Exclusion Standard data for ferrero.nl
Resource Scan
Scan Details
Site Domain | ferrero.nl |
Base Domain | ferrero.nl |
Scan Status | Ok |
Last Scan | 2024-10-17T14:12:06+00:00 |
Next Scan | 2024-11-16T14:12:06+00:00 |
Last Scan
Scanned | 2024-10-17T14:12:06+00:00 |
URL | https://www.ferrero.nl/robots.txt |
Domain IPs | 125.56.219.2, 23.32.29.89, 2600:1413:b000:1d::17d1:2e91, 2600:1413:b000:1d::17d1:2e94 |
Response IP | 23.32.29.89 |
Found | Yes |
Hash | 97302815401c878630356a95c2b698b5cb6f175ef949e877dda0b61ca02236ee |
SimHash | 29494c872f92 |
Groups
*
Rule | Path |
---|---|
Disallow | /inc/ |
Disallow | /layouts/ |
Disallow | /index.php |
Disallow | /Technical_and_Organizational_Security_Measures |
Disallow | /fc-4614 |
Other Records
Field | Value |
---|---|
sitemap | http://www.ferrero.nl/sitemap.xml |