ewrc-results.com
robots.txt

Robots Exclusion Standard data for ewrc-results.com

Resource Scan

Scan Details

Site Domain ewrc-results.com
Base Domain ewrc-results.com
Scan Status Ok
Last Scan2024-09-30T04:42:44+00:00
Next Scan 2024-10-07T04:42:44+00:00

Last Scan

Scanned2024-09-30T04:42:44+00:00
URL https://ewrc-results.com/robots.txt
Redirect https://www.ewrc-results.com/robots.txt
Redirect Domain www.ewrc-results.com
Redirect Base ewrc-results.com
Domain IPs 217.198.116.84, 2a00:19a0:3:74:0:d9c6:7454:1
Redirect IPs 217.198.116.84, 2a00:19a0:3:74:0:d9c6:7454:1
Response IP 217.198.116.84
Found Yes
Hash 172297ae618452dc1ce7d3a2dd60d6f16c661265c1fec742a814d3ee98f6f32a
SimHash e9315a12c7ff

Groups

*

Rule Path
Disallow /

seznambot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 4

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

facebookbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

ia_archiver

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

twitterbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2