mijnserie.nl
robots.txt

Robots Exclusion Standard data for mijnserie.nl

Resource Scan

Scan Details

Site Domain mijnserie.nl
Base Domain mijnserie.nl
Scan Status Ok
Last Scan2024-09-22T16:13:50+00:00
Next Scan 2024-09-29T16:13:50+00:00

Last Scan

Scanned2024-09-22T16:13:50+00:00
URL https://mijnserie.nl/robots.txt
Redirect https://www.mijnserie.nl/robots.txt
Redirect Domain www.mijnserie.nl
Redirect Base mijnserie.nl
Domain IPs 104.21.67.29, 172.67.211.150, 2606:4700:3033::ac43:d396, 2606:4700:3036::6815:431d
Redirect IPs 104.21.67.29, 172.67.211.150, 2606:4700:3033::ac43:d396, 2606:4700:3036::6815:431d
Response IP 172.67.211.150
Found Yes
Hash 06b0094c6c1232567cb8e76a142f3445ed28ec9de6d2a841aea0793dbc163eb1
SimHash 6d19dc54e3f3

Groups

*

Rule Path
Disallow *.jpg$
Disallow *.png$
Disallow *.gif$

Other Records

Field Value
crawl-delay 5