compamia.com
robots.txt

Robots Exclusion Standard data for compamia.com

Resource Scan

Scan Details

Site Domain compamia.com
Base Domain compamia.com
Scan Status Ok
Last Scan2025-11-28T15:19:02+00:00
Next Scan 2025-12-28T15:19:02+00:00

Last Scan

Scanned2025-11-28T15:19:02+00:00
URL https://compamia.com/robots.txt
Redirect https://www.compamia.com/robots.txt
Redirect Domain www.compamia.com
Redirect Base compamia.com
Domain IPs 67.59.146.11
Redirect IPs 67.59.146.11
Response IP 67.59.146.11
Found Yes
Hash 9a004f4e23175a5a48432d5c4636f73ff2d7b3d697e0faee5a03c5657b3111d5
SimHash 46204d43eab0

Groups

ahrefsbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

moget

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sougou web spider

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

unknown bot

Rule Path
Disallow /

unknown crawler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisou spider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

xaldon_webspider

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

*

Rule Path
Disallow /_tools
Disallow /cs/About/
Disallow /cs/App_Data/
Disallow /cs/bin/
Disallow /cs/CaptchaImageHandler.ashx
Disallow /cs/ChatLink.ashx
Disallow /cs/ChatLinkStyles.ashx
Disallow /cs/ChatScript.ashx
Disallow /cs/Common/
Disallow /cs/community/*/ThreadPanels
Disallow /cs/dist/
Disallow /cs/frmError.aspx
Disallow /cs/GettingStarted.html
Disallow /cs/HttpHandlers/
Disallow /cs/Login.aspx
Disallow /cs/m/
Disallow /cs/Main/Chat/
Disallow /cs/Main/frmMySettings.aspx
Disallow /cs/Main/frmTicket.aspx
Disallow /cs/Main/frmVerifyAccount.aspx
Disallow /cs/Main/Login.aspx
Disallow /cs/Management/
Disallow /cs/Ping.aspx
Disallow /cs/ScriptResource.axd
Disallow /cs/Services/
Disallow /cs/Services2/
Disallow /cs/ST.ashx
Disallow /cs/WebResource.axd
Disallow /cs/WhosOnLink.ashx

Other Records

Field Value
sitemap https://www.compamia.com/sitemap.xml