portal.wiktrop.org
robots.txt

Robots Exclusion Standard data for portal.wiktrop.org

Resource Scan

Scan Details

Site Domain portal.wiktrop.org
Base Domain wiktrop.org
Scan Status Ok
Last Scan2025-11-28T21:40:15+00:00
Next Scan 2025-12-12T21:40:15+00:00

Last Scan

Scanned2025-11-28T21:40:15+00:00
URL https://portal.wiktrop.org/robots.txt
Domain IPs 194.199.235.130
Response IP 194.199.235.130
Found Yes
Hash 96e9b5ad211246145726c64eb0a3a7e6850545f17e646a76f7cc6e8f0ddc3e8d
SimHash e814dc9267e3

Groups

googlebot

Rule Path
Allow /
Disallow /namelist/

googlebot-image

Rule Path
Allow /
Disallow /namelist/

googlebot-mobile

Rule Path
Allow /
Disallow /namelist/

bingbot

Rule Path
Disallow /

duckduckbot

Rule Path
Allow /
Disallow /namelist/

twitterbot

Rule Path
Allow /
Disallow /namelist/

facebookexternalhit

Rule Path
Allow /
Disallow /namelist/

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10