reduxgaming.nl
robots.txt

Robots Exclusion Standard data for reduxgaming.nl

Resource Scan

Scan Details

Site Domain reduxgaming.nl
Base Domain reduxgaming.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-11T13:37:18+00:00
Next Scan 2025-07-18T13:37:18+00:00

Last Successful Scan

Scanned2025-06-10T12:15:18+00:00
URL https://reduxgaming.nl/robots.txt
Domain IPs 2a01:7c8:f0:1141:0:2:3de4:6d2e, 80.69.67.6
Response IP 80.69.67.6
Found Yes
Hash f261cd112cbecb043650a6a8f88b25f0b271f470b08bdcad973be4718bc6d7f4
SimHash 2010d80244b1

Groups

teoma

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

nutch

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

psbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

teracent-feed-processing

Rule Path
Disallow /

ingrid

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

jyxobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

*

Rule Path
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://reduxgaming.nl/sitemap_index.xml