marketupdate.nl
robots.txt

Robots Exclusion Standard data for marketupdate.nl

Resource Scan

Scan Details

Site Domain marketupdate.nl
Base Domain marketupdate.nl
Scan Status Ok
Last Scan2025-04-08T07:22:53+00:00
Next Scan 2025-04-15T07:22:53+00:00

Last Scan

Scanned2025-04-08T07:22:53+00:00
URL https://marketupdate.nl/robots.txt
Domain IPs 104.21.47.239, 172.67.174.138, 2606:4700:3031::ac43:ae8a, 2606:4700:3035::6815:2fef
Response IP 104.21.47.239
Found Yes
Hash d7b1ff0570ed75596a884882000c557ccfff9d2226030332d626d26ac727f192
SimHash f71ec4d25811

Groups

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20