englisharchives.mathrubhumi.com
robots.txt

Robots Exclusion Standard data for englisharchives.mathrubhumi.com

Resource Scan

Scan Details

Site Domain englisharchives.mathrubhumi.com
Base Domain mathrubhumi.com
Scan Status Ok
Last Scan2024-04-30T19:20:41+00:00
Next Scan 2024-05-07T19:20:41+00:00

Last Scan

Scanned2024-04-30T19:20:41+00:00
URL https://englisharchives.mathrubhumi.com/robots.txt
Redirect https://englisharchives.mathrubhumi.com/?ot=com.atex.plugins.seoplugin.RobotsTxt.ot
Domain IPs 35.154.117.181
Response IP 35.154.117.181
Found Yes
Hash eeb7b1ccae3a61b8a0bf269d72604454451ea75e83a128bc7ab3c383d248ebca
SimHash 68244891a1f4

Groups

*

Rule Path
Allow /
Disallow /WEB-INF
Disallow /META-INF
Disallow /polopolydevelopment/
Disallow /status/
Disallow /search-results/
Disallow /poll/
Disallow /logger/
Disallow /cm/
Disallow /cmlink/
Disallow /error/
Disallow /errorpages/
Disallow /content/
Disallow /captcha/
Disallow /membership/
Disallow /blogimageupload/
Disallow /263
Disallow /json
Disallow /tabjson
Disallow /webpage
Disallow /sponsored/
Disallow /section/

googlebot-news

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /image/

twitterbot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /