Log In Sign Up

company.o2jam.com
robots.txt

Robots Exclusion Standard data for company.o2jam.com

Resource Scan

Scan Details

Site Domain company.o2jam.com
Base Domain o2jam.com
Scan Status Ok
Last Scan2024-10-17T10:26:01+00:00
Next Scan 2024-11-16T10:26:01+00:00

Last Scan

Scanned2024-10-17T10:26:01+00:00
URL http://company.o2jam.com/robots.txt
Domain IPs 52.69.30.97
Response IP 52.69.30.97
Found Yes
Hash 37218f8b9491fdbdbc6128f3a0440c8d0b5a9e5b20460d2dda1b4e13bc244326
SimHash 0017f3204e18

Groups

*

Rule Path
Allow /

baiduspider

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

exabot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

q_blogbot

Rule Path
Disallow /

qt_blogbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

nkbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

yeti

Rule Path
Allow /
Back to top