gurgaonmoms.com
robots.txt
Robots Exclusion Standard data for gurgaonmoms.com
Resource Scan
Scan Details
| Site Domain | gurgaonmoms.com |
| Base Domain | gurgaonmoms.com |
| Scan Status | Ok |
| Last Scan | 2024-11-07T01:16:02+00:00 |
| Next Scan | 2024-12-07T01:16:02+00:00 |
Last Scan
| Scanned | 2024-11-07T01:16:02+00:00 |
| URL | https://gurgaonmoms.com/robots.txt |
| Domain IPs | 104.21.82.158, 172.67.158.244, 2606:4700:3032::ac43:9ef4, 2606:4700:3035::6815:529e |
| Response IP | 172.67.158.244 |
| Found | Yes |
| Hash | 0aa8b244321b50bf3d9e91ad486766c67395e1ebc8a08650ff7eab2523508030 |
| SimHash | 12f80c32a8f2 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /calendar/action~posterboard/ | - |
| Disallow | /calendar/action~agenda/ | - |
| Disallow | /calendar/action~oneday/ | - |
| Disallow | /calendar/action~month/ | - |
| Disallow | /calendar/action~week/ | - |
| Disallow | /calendar/action~stream/ | - |
| Disallow | /calendar/action~undefined/ | - |
| Disallow | /calendar/action~http%3A/ | - |
| Disallow | /calendar/action~default/ | - |
| Disallow | /calendar/action~poster/ | - |
| Disallow | /calendar/action~*/ | - |
| Disallow | /*controller%3Dai1ec_exporter_controller* | - |
| Disallow | /*/action~*/ | - |
| Disallow | /calendar-2/action~posterboard/ | - |
| Disallow | /calendar-2/action~agenda/ | - |
| Disallow | /calendar-2/action~oneday/ | - |
| Disallow | /calendar-2/action~month/ | - |
| Disallow | /calendar-2/action~week/ | - |
| Disallow | /calendar-2/action~stream/ | - |
| Disallow | /calendar-2/action~undefined/ | - |
| Disallow | /calendar-2/action~http%3A/ | - |
| Disallow | /calendar-2/action~default/ | - |
| Disallow | /calendar-2/action~poster/ | - |
| Disallow | /calendar-2/action~*/ | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/ | block access to internal search result pages |
| Disallow | *?s=* | block access to internal search result pages |
| Disallow | *?p=* | block access to pages for which permalinks fails |
| Disallow | *%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
unisterbot
dotbot
searchmetricsbot
surveybot
seodiver
spbot
wotbox
meanpathbot
backlinkcrawler
magpie-crawler
obot
fr-crawler
blexbot
megaindex.ru
megaindex.com
cloudservermarketspider
trendictionbot
exabot
careerbot
lipperhey-kaus-australis
seoscanners.net
metajobbot
spiderbot
linkstats
jobboersebot
iccrawler
plista
domain re-animator bot
turnitinbot
coccoc
um-ic
mindupbot
sg-orbiter
ccbot
qwantify
kraken
plukkie
safednsbot
haosouspider
rogerbot
openhosebot
screaming frog seo spider
thumbsniper
r6_commentreader
implisensebot
cliqzbot
aihitbot
adscanner
crawler4j
wbsearchbot
python/3.5 aiohttp
toweya.com
netestate
bubing
linguee
semrushbot
semrushbot-sa
sentibot
sentibot
velenpublicwebcrawler
domaincrawler
indeedbot
garlikcrawler
gosign-security-crawler
siteliner
sabsimbot
ltx71
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| sitemap | https://gurgaonmoms.com/sitemap.xml |
Warnings
- 1 invalid line.
Comments