elvaltrandi.com
robots.txt

Robots Exclusion Standard data for elvaltrandi.com

Resource Scan

Scan Details

Site Domain elvaltrandi.com
Base Domain elvaltrandi.com
Scan Status Ok
Last Scan2024-09-06T00:28:48+00:00
Next Scan 2024-10-06T00:28:48+00:00

Last Scan

Scanned2024-09-06T00:28:48+00:00
URL https://elvaltrandi.com/robots.txt
Domain IPs 104.21.88.254, 172.67.155.51, 2606:4700:3035::6815:58fe, 2606:4700:3036::ac43:9b33
Response IP 172.67.155.51
Found Yes
Hash 8c106c6fce3ffe62f8cb9bb56070b5e00d2f7c9a450a03d9a178c027e334f6f1
SimHash d65e59506880

Groups

*

Rule Path
Disallow /private/
Disallow /test/
Disallow /profile/
Disallow /search/
Disallow /support/
Disallow /contact/
Disallow /inbox/
Disallow /login/
Disallow /register/
Disallow /pages/
Disallow /faq/
Disallow /set-display/
Disallow /*?h=*

Other Records

Field Value
crawl-delay 10

amazonbot
semrushbot
ahrefsbot
mj12bot
dotbot
megaindex.ru
megaindex.com
panscient
panscient.com
serpstatbot
blexbot
inktomi slurp
nimbostratus
seznambot
brands-bot-logo
brands-bot
bbot
petalbot
zoominfobot
seokicks
mojeekbot
mauibot
mtrobot
linguee
indeedbot
aasa-bot
tkbot
dataforseobot
bl.uk_lddc_bot
paracrawl
gptbot
chatgpt-user
claudebot
anthropic-ai
claude-web
google-extended
ccbot

Rule Path
Disallow /