Log In Sign Up

paulcamper.nl
robots.txt

Robots Exclusion Standard data for paulcamper.nl

Resource Scan

Scan Details

Site Domain paulcamper.nl
Base Domain paulcamper.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-30T00:49:46+00:00
Next Scan 2026-01-13T00:49:46+00:00

Last Successful Scan

Scanned2025-12-06T20:15:26+00:00
URL https://paulcamper.nl/robots.txt
Redirect https://paulcamper.nl/robots-nl.txt
Domain IPs 2600:9000:2153:1600:4:af7d:bac0:93a1, 2600:9000:2153:2e00:4:af7d:bac0:93a1, 2600:9000:2153:4400:4:af7d:bac0:93a1, 2600:9000:2153:6a00:4:af7d:bac0:93a1, 2600:9000:2153:7200:4:af7d:bac0:93a1, 2600:9000:2153:7e00:4:af7d:bac0:93a1, 2600:9000:2153:a600:4:af7d:bac0:93a1, 2600:9000:2153:d000:4:af7d:bac0:93a1, 65.8.76.112, 65.8.76.116, 65.8.76.36, 65.8.76.99
Response IP 65.8.76.99
Found Yes
Hash 94e3730a73fa3dfdbd7bf7bd1e29d75e22379a87b4adefd1abed56890e515112
SimHash eabd4d150d50

Groups

*

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /user
Disallow /account
Disallow /password
Disallow /api
Disallow /owner-pds
Disallow /.well-known/
Disallow /apple-app-site-association
Disallow /apple-developer-merchantid-domain-association.txt
Disallow /assetlinks.json
Back to top

Other Records

Field Value
sitemap https://www.paulcamper.nl/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top