538.nl
robots.txt

Robots Exclusion Standard data for 538.nl

Resource Scan

Scan Details

Site Domain 538.nl
Base Domain 538.nl
Scan Status Ok
Last Scan2024-05-22T14:39:25+00:00
Next Scan 2024-05-29T14:39:25+00:00

Last Scan

Scanned2024-05-22T14:39:25+00:00
URL https://538.nl/robots.txt
Redirect https://www.538.nl/robots.txt
Redirect Domain www.538.nl
Redirect Base 538.nl
Domain IPs 13.226.2.100, 13.226.2.13, 13.226.2.64, 13.226.2.74
Redirect IPs 108.156.133.113, 108.156.133.120, 108.156.133.68, 108.156.133.85, 2600:9000:260e:1200:2:fd91:2bc0:93a1, 2600:9000:260e:1a00:2:fd91:2bc0:93a1, 2600:9000:260e:2400:2:fd91:2bc0:93a1, 2600:9000:260e:600:2:fd91:2bc0:93a1, 2600:9000:260e:9200:2:fd91:2bc0:93a1, 2600:9000:260e:b400:2:fd91:2bc0:93a1, 2600:9000:260e:d600:2:fd91:2bc0:93a1, 2600:9000:260e:e200:2:fd91:2bc0:93a1
Response IP 108.156.133.113
Found Yes
Hash 3eaea367cb249e742fbfc8bacfb80118f29af648203d9bff68d9cca321beec29
SimHash 680dd8348913

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.538.nl/sitemaps/radio538/sitemap.xml
sitemap https://www.538.nl/sitemaps/radio538/sitemap_news.xml