538.nl
robots.txt

Robots Exclusion Standard data for 538.nl

Resource Scan

Scan Details

Site Domain 538.nl
Base Domain 538.nl
Scan Status Ok
Last Scan2024-11-14T05:17:35+00:00
Next Scan 2024-11-21T05:17:35+00:00

Last Scan

Scanned2024-11-14T05:17:35+00:00
URL https://538.nl/robots.txt
Redirect https://www.538.nl/robots.txt
Redirect Domain www.538.nl
Redirect Base 538.nl
Domain IPs 13.226.2.100, 13.226.2.13, 13.226.2.64, 13.226.2.74
Redirect IPs 108.156.133.113, 108.156.133.120, 108.156.133.68, 108.156.133.85, 2600:9000:2755:1e00:2:fd91:2bc0:93a1, 2600:9000:2755:3c00:2:fd91:2bc0:93a1, 2600:9000:2755:400:2:fd91:2bc0:93a1, 2600:9000:2755:4400:2:fd91:2bc0:93a1, 2600:9000:2755:5200:2:fd91:2bc0:93a1, 2600:9000:2755:7400:2:fd91:2bc0:93a1, 2600:9000:2755:9c00:2:fd91:2bc0:93a1, 2600:9000:2755:ae00:2:fd91:2bc0:93a1
Response IP 108.156.133.120
Found Yes
Hash 3eaea367cb249e742fbfc8bacfb80118f29af648203d9bff68d9cca321beec29
SimHash 680dd8348913

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.538.nl/sitemaps/radio538/sitemap.xml
sitemap https://www.538.nl/sitemaps/radio538/sitemap_news.xml