pu.nl
robots.txt

Robots Exclusion Standard data for pu.nl

Resource Scan

Scan Details

Site Domain pu.nl
Base Domain pu.nl
Scan Status Ok
Last Scan2024-06-23T15:19:30+00:00
Next Scan 2024-06-30T15:19:30+00:00

Last Scan

Scanned2024-06-23T15:19:30+00:00
URL https://pu.nl/robots.txt
Domain IPs 34.102.175.97
Response IP 34.102.175.97
Found Yes
Hash 83d553caa1cd4f2b9e9231f99010acfd88e488eddebdd53ccc53933b25827095
SimHash 644d9854f313

Groups

*

Rule Path
Disallow /*?scrollTo
Disallow /*do%3Dfind
Disallow /*?_node
Disallow /*?_theme*

Other Records

Field Value
sitemap https://sitemaps.reshift.nl/sitemaps/pu.nl/sitemap.xml

Comments

  • https://www.robotstxt.org/robotstxt.html