algunforum.com
robots.txt
Robots Exclusion Standard data for algunforum.com
Resource Scan
Scan Details
Site Domain | algunforum.com |
Base Domain | algunforum.com |
Scan Status | Ok |
Last Scan | 2024-05-22T11:18:20+00:00 |
Next Scan | 2024-05-29T11:18:20+00:00 |
Last Scan
Scanned | 2024-05-22T11:18:20+00:00 |
URL | https://algunforum.com/robots.txt |
Redirect | https://www.algunforum.com/robots.txt |
Redirect Domain | www.algunforum.com |
Redirect Base | algunforum.com |
Domain IPs | 192.69.219.10 |
Redirect IPs | 192.69.219.10 |
Response IP | 192.69.219.10 |
Found | Yes |
Hash | 8ebd285274157614bd3959b12929a65ae762439dde5a99fd0f45eec66a9750c7 |
SimHash | b25543da4f83 |
Groups
ahrefsbot
baidu
baiduspider
baiduspider-video
baiduspider-image
boardreader
boardtracker
cliqzbot
diffbot
dotbot
easouspider
exabot
gigabot
linkdexbot
linkdexbot-mobile
magpie-crawler
meanpathbot
mj12bot
naverbot
omgilibot
proximic
rogerbot
semrushbot
semrushbot-sa
sitebot
sogou
sogou spider
sogou web spider
sosospider
spbot
trendictionbot
twiceler
urlappendbot
yandex
yeti
youdaobot
semrushbot
Rule | Path |
---|---|
Disallow | / |