besuconas.com
robots.txt

Robots Exclusion Standard data for besuconas.com

Resource Scan

Scan Details

Site Domain besuconas.com
Base Domain besuconas.com
Scan Status Ok
Last Scan2024-06-24T04:22:58+00:00
Next Scan 2024-07-24T04:22:58+00:00

Last Scan

Scanned2024-06-24T04:22:58+00:00
URL https://besuconas.com/robots.txt
Domain IPs 104.21.233.125, 104.21.233.126, 2606:4700:3038::6815:e97d, 2606:4700:3038::6815:e97e
Response IP 104.21.233.126
Found Yes
Hash d2e3247723cc261cdc49cc866f86553ce6009ff0f54e00d5fc39241906a9fd7b
SimHash 1001d5cac902

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /feed/
Disallow /comments/feed/
Disallow /wp-content/themes/xxx/salta.js
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

xovi

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

seodiver

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /