refinery89.nl
robots.txt

Robots Exclusion Standard data for refinery89.nl

Resource Scan

Scan Details

Site Domain refinery89.nl
Base Domain refinery89.nl
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-26T13:18:20+00:00
Next Scan 2024-11-24T13:18:20+00:00

Last Successful Scan

Scanned2024-04-29T12:14:11+00:00
URL http://refinery89.nl/robots.txt
Redirect https://www.xgn.nl/robots.txt
Redirect Domain www.xgn.nl
Redirect Base xgn.nl
Domain IPs 54.93.187.91
Redirect IPs 104.21.33.24, 172.67.140.101, 2606:4700:3035::6815:2118, 2606:4700:3035::ac43:8c65
Response IP 104.21.33.24
Found Yes
Hash 9c437f9ec779824e6f0a6d88b196e7d859980b263e879ff8c518024fe9a0a6f7
SimHash 68051c44ab92

Groups

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://xgn.nl/sitemap/news.xml