sv1.mathrubhumi.com
robots.txt

Robots Exclusion Standard data for sv1.mathrubhumi.com

Resource Scan

Scan Details

Site Domain sv1.mathrubhumi.com
Base Domain mathrubhumi.com
Scan Status Ok
Last Scan2024-05-07T07:39:42+00:00
Next Scan 2024-05-14T07:39:42+00:00

Last Scan

Scanned2024-05-07T07:39:42+00:00
URL https://sv1.mathrubhumi.com/robots.txt
Domain IPs 13.232.249.206
Response IP 13.232.249.206
Found Yes
Hash 504aefa76b0db42bd7fd52086237fad29ed7f93e97dacc268b52679257d725d3
SimHash 451a9a44a8cc

Groups

ia_archiver

Rule Path
Disallow /

alexabot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /classifieds.php
Disallow /classifieds/
Disallow /index.html
Disallow /home.php
Disallow /home_cache.php
Disallow /home.html
Disallow /print.php
Disallow /print.html
Disallow /localnews
Disallow /local
Disallow /2006_customimages
Disallow /2007_customimages
Disallow /2008_customimages
Disallow /2009_customimages
Disallow /2010_customimages
Disallow /__education
Disallow /_private
Disallow /_vti_bin
Disallow /_vti_cnf
Disallow /_vti_log
Disallow /_vti_pvt
Disallow /_vti_txt
Disallow /advt
Disallow /art
Disallow /askme
Disallow /astrology
Disallow /backup
Disallow /backup13-oct-2008
Disallow /calendar
Disallow /cgi_bin
Disallow /css
Disallow /eot
Disallow /flashnews
Disallow /greetings
Disallow /html
Disallow /img
Disallow /include
Disallow /job
Disallow /Library
Disallow /new
Disallow /new09
Disallow /new_data
Disallow /newsletter
Disallow /old
Disallow /php
Disallow /rewrite
Disallow /score
Disallow /scripts
Disallow /static-old
Disallow /staticdb
Disallow /sthree
Disallow /support
Disallow /temp
Disallow /travelandtourism
Disallow /unicode
Disallow /uploaded_files
Disallow /usage
Disallow /UserFiles
Disallow /webadmin
Disallow /xoad
Disallow /english/php
Disallow /english/css
Disallow /english/ticker
Disallow /english/js
Disallow /english/img
Disallow /english/videos/js
Disallow /english/videos/php
Disallow /english/videos/img
Disallow /english/videos/images
Disallow /english/videos/css
Disallow /travel/accordion
Disallow /travel/ajax
Disallow /travel/css
Disallow /travel/gallery
Disallow /travel/destination
Disallow /travel/header
Disallow /travel/images
Disallow /travel/img
Disallow /travel/js
Disallow /travel/maps
Disallow /travel/menu
Disallow /travel/message
Disallow /travel/php
Disallow /travel/posters
Disallow /travel/spots
Disallow /travel/swfupload
Disallow /travel/uploaded
Disallow /travel/video
Disallow /travel/we
Disallow /travel/xml
Disallow /travel/yathra
Disallow /new09/backup
Disallow /mobile
Disallow /extras/special

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /