wikido.com
robots.txt

Robots Exclusion Standard data for wikido.com

Resource Scan

Scan Details

Site Domain wikido.com
Base Domain wikido.com
Scan Status Ok
Last Scan2024-09-21T03:07:39+00:00
Next Scan 2024-09-28T03:07:39+00:00

Last Scan

Scanned2024-09-21T03:07:39+00:00
URL https://wikido.com/robots.txt
Redirect https://www.wikido.com/robots.txt
Redirect Domain www.wikido.com
Redirect Base wikido.com
Domain IPs 104.26.12.170, 104.26.13.170, 172.67.71.155, 2606:4700:20::681a:caa, 2606:4700:20::681a:daa, 2606:4700:20::ac43:479b
Redirect IPs 104.26.12.170, 104.26.13.170, 172.67.71.155, 2606:4700:20::681a:caa, 2606:4700:20::681a:daa, 2606:4700:20::ac43:479b
Response IP 104.26.12.170
Found Yes
Hash 4548417a775d206217d7a1a622eebce610a0722709ea540eb5443f7b8699c583
SimHash c31eb071e3f1

Groups

ahrefsbot

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

*

Rule Path
Disallow /css/
Disallow /search?*
Disallow /search.php
Disallow /search.php*
Disallow /scheda_update*
Disallow /profile_ext*
Allow /us/*/*/$
Allow /us/*/*/2$
Allow /us/*/*/3$
Allow /us/*/*/4$
Allow /us/*/*/5$
Allow /us/*/*/6$
Allow /us/*/*/7$
Allow /us/*/*/8$
Allow /us/*/*/9$
Allow /us/*/*/10$
Allow /us/*/*/event/*
Allow /us/*/county/*
Disallow /us/*/*-$
Disallow /us/*/*-/$
Disallow /us/*/*/*
Disallow /us/*/*/*/$
Disallow /us/*/*/*/2$
Disallow /us/*/*/*/3$
Disallow /us/*/*/*/4$
Disallow /event/*/edit
Disallow /remove_*/*

bingbot

Rule Path
Disallow /live/*

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.wikido.com/sitemap_gen.xml
sitemap https://www.wikido.com/sitemap_live.xml