godrejinterio.com
robots.txt

Robots Exclusion Standard data for godrejinterio.com

Resource Scan

Scan Details

Site Domain godrejinterio.com
Base Domain godrejinterio.com
Scan Status Ok
Last Scan2024-11-16T16:30:52+00:00
Next Scan 2024-12-16T16:30:52+00:00

Last Scan

Scanned2024-11-16T16:30:52+00:00
URL https://godrejinterio.com/robots.txt
Redirect https://www.godrejinterio.com/robots.txt
Redirect Domain www.godrejinterio.com
Redirect Base godrejinterio.com
Domain IPs 13.227.254.102, 13.227.254.27, 13.227.254.30, 13.227.254.43
Redirect IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91, 2a04:4e42:200::347, 2a04:4e42:400::347, 2a04:4e42:600::347, 2a04:4e42::347
Response IP 199.232.45.91
Found Yes
Hash 3e46332bed707109b9a423c54318b5b6ce7d2c91efebde967ecf9f17c96f0b73
SimHash dbc55463c512

Groups

*

Rule Path
Disallow *aspx*
Disallow *pdf*
Disallow /search*
Disallow /%26sa%3DU*
Disallow /Godrejinterio*
Disallow /pdp*
Disallow /ADVERTISEMENT*
Disallow /godrej*
Disallow /blog/tag*

aitcsrobot/1.1

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

aqua_products

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

arachnophilia

Rule Path
Disallow /

aspider/0.09

Rule Path
Disallow /

asterias

Rule Path
Disallow /

asterias

Rule Path
Disallow /

b2w/0.1

Rule Path
Disallow /

backdoorbot

Rule Path
Disallow /

backdoorbot

Rule Path
Disallow /

backdoorbot/1.0

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

big brother

Rule Path
Disallow /

bizbot003

Rule Path
Disallow /

bizbot04 kirk.overleaf.com

Rule Path
Disallow /

black hole

Rule Path
Disallow /

black.hole

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

blowfish

Rule Path
Disallow /

bookmark search tool

Rule Path
Disallow /

bot mailto:craftbot@yahoo.com

Rule Path
Disallow /

botrighthere

Rule Path
Disallow /

bspider/1.0 libwww-perl/0.40

Rule Path
Disallow /

builtbottough

Rule Path
Disallow /

bullseye

Rule Path
Disallow /

bullseye/1.0

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.godrejinterio.com/sitemap.xml