knowgramming.com
robots.txt

Robots Exclusion Standard data for knowgramming.com

Resource Scan

Scan Details

Site Domain knowgramming.com
Base Domain knowgramming.com
Scan Status Ok
Last Scan2024-09-20T11:25:22+00:00
Next Scan 2024-10-20T11:25:22+00:00

Last Scan

Scanned2024-09-20T11:25:22+00:00
URL http://knowgramming.com/robots.txt
Domain IPs 216.251.32.98
Response IP 216.251.32.98
Found Yes
Hash 742b9e554010458279998adfc59403df7078d9bee8aae573282b5278e067bbed
SimHash 245453825595

Groups

adsbot-google

Rule Path
Disallow

alexa

Rule Path
Disallow

alexabot

Rule Path
Disallow

applewebkit

Rule Path
Disallow

asterias

Rule Path
Disallow

baiduspider

Rule Path
Disallow

bingbot

Rule Path
Disallow

gecko

Rule Path
Disallow

gigabot

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

msnbot

Rule Path
Disallow

msnbot-media

Rule Path
Disallow

msnbot-news

Rule Path
Disallow

msnptc

Rule Path
Disallow

naverbot

Rule Path
Disallow

nutch

Rule Path
Disallow

psbot

Rule Path
Disallow

robozilla

Rule Path
Disallow

scoutjet

Rule Path
Disallow

scrubby

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

twiceler

Rule Path
Disallow

yahoo-blogs

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yandex

Rule Path
Disallow

yeti

Rule Path
Disallow

*

Rule Path
Disallow /