pen.nl
robots.txt

Robots Exclusion Standard data for pen.nl

Resource Scan

Scan Details

Site Domain pen.nl
Base Domain pen.nl
Scan Status Ok
Last Scan2024-06-08T01:54:57+00:00
Next Scan 2024-06-15T01:54:57+00:00

Last Scan

Scanned2024-06-08T01:54:57+00:00
URL https://pen.nl/robots.txt
Domain IPs 93.158.223.52
Response IP 93.158.223.52
Found Yes
Hash 2826d49ef481bbcf276ec528f1463e45d2d9985524570eb36653461e614169a5
SimHash 1430d8208742

Groups

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path Comment
Disallow / disallow this directory