cellbits.com
robots.txt

Robots Exclusion Standard data for cellbits.com

Resource Scan

Scan Details

Site Domain cellbits.com
Base Domain cellbits.com
Scan Status Ok
Last Scan2024-09-28T15:47:27+00:00
Next Scan 2024-10-05T15:47:27+00:00

Last Scan

Scanned2024-09-28T15:47:27+00:00
URL http://cellbits.com/robots.txt
Domain IPs 50.63.7.189
Response IP 50.63.7.189
Found Yes
Hash 57595885ee5f91ff3937fac79c5c1123b1436336697327606d51e2f6b1fc72c2
SimHash 0a9fff832781

Groups

mediapartners-google*

Rule Path
Disallow

googlebot-image

Rule Path
Disallow /

googlebot

Rule Path
Disallow

*

Rule Path
Disallow /wap/
Disallow /tests/
Disallow /search/
Disallow /stats/
Disallow /images

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /wap/
Disallow /tests/
Disallow /search/
Disallow /stats/
Disallow /images/

yandexmedia

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexdirect

Rule Path
Disallow /

yandexmetrika

Rule Path
Disallow /

yandexblogs

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

psbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

willybot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /