Log In Sign Up

en.wiki.forgeofempires.com
robots.txt

Robots Exclusion Standard data for en.wiki.forgeofempires.com

Resource Scan

Scan Details

Site Domain en.wiki.forgeofempires.com
Base Domain forgeofempires.com
Scan Status Ok
Last Scan2025-04-24T14:57:34+00:00
Next Scan 2025-05-24T14:57:34+00:00

Last Scan

Scanned2025-04-24T14:57:34+00:00
URL https://en.wiki.forgeofempires.com/robots.txt
Domain IPs 212.48.106.185, 2a00:1f78:fffd:2::d430:6ab9
Response IP 212.48.106.185
Found Yes
Hash e2f96455d5dbcf3f1c3769578ebbe90f6b7258bc40c0039084a025d0c1547e57
SimHash 73965631ce83

Groups

claudebot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

swiftbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

facebot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

operator

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

backlinksextendedbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

neticle crawler

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

timpibot

Rule Path
Disallow /
Back to top