veilingdorp.nl
robots.txt

Robots Exclusion Standard data for veilingdorp.nl

Resource Scan

Scan Details

Site Domain veilingdorp.nl
Base Domain veilingdorp.nl
Scan Status Ok
Last Scan2024-11-14T01:42:57+00:00
Next Scan 2024-11-21T01:42:57+00:00

Last Scan

Scanned2024-11-14T01:42:57+00:00
URL https://veilingdorp.nl/robots.txt
Redirect https://www.tweedehands.net/robots.txt
Redirect Domain www.tweedehands.net
Redirect Base tweedehands.net
Domain IPs 76.76.21.21
Redirect IPs 34.117.253.57
Response IP 34.117.253.57
Found Yes
Hash 771061b75eec063860725ec4e0a9024537512b263ff9822097703345d53c28ed
SimHash 78289e706893

Groups

*

Rule Path
Disallow /api
Disallow /horizon
Disallow /cp
Disallow /mijn-account

Other Records

Field Value
sitemap https://tweedehands.net/sitemap/sitemap.xml