drnikhilshirsi.com
robots.txt

Robots Exclusion Standard data for drnikhilshirsi.com

Resource Scan

Scan Details

Site Domain drnikhilshirsi.com
Base Domain drnikhilshirsi.com
Scan Status Ok
Last Scan2025-07-02T22:13:30+00:00
Next Scan 2025-08-01T22:13:30+00:00

Last Scan

Scanned2025-07-02T22:13:30+00:00
URL https://drnikhilshirsi.com/robots.txt
Redirect https://www.drnikhilshirsi.com/robots.txt
Redirect Domain www.drnikhilshirsi.com
Redirect Base drnikhilshirsi.com
Domain IPs 13.35.37.2, 13.35.37.20, 13.35.37.33, 13.35.37.54
Redirect IPs 13.35.37.2, 13.35.37.20, 13.35.37.33, 13.35.37.54, 2600:9000:213e:1a00:4:7c8b:3380:93a1, 2600:9000:213e:2c00:4:7c8b:3380:93a1, 2600:9000:213e:4400:4:7c8b:3380:93a1, 2600:9000:213e:8a00:4:7c8b:3380:93a1, 2600:9000:213e:a000:4:7c8b:3380:93a1, 2600:9000:213e:ca00:4:7c8b:3380:93a1, 2600:9000:213e:ce00:4:7c8b:3380:93a1, 2600:9000:213e:f800:4:7c8b:3380:93a1
Response IP 13.35.37.33
Found Yes
Hash 8461de72479710dc8c8a043e2f642dccb1fa79bd582d78d61194de56aa0d4c56
SimHash b1551474cf10

Groups

*

Rule Path
Disallow /cart/
Disallow /checkout
Disallow /gmc-and-refund-policy
Disallow /resubscribe
Disallow /securepay
Disallow /transaction-status
Disallow /unsubscribe
Disallow /404
Disallow /500
Disallow /fonts/
Disallow /partial/
Disallow */search/*/2
Disallow */search/*/3
Disallow */search/*/4
Disallow */search/*/5
Disallow */search/*/6
Disallow */search/*/7
Disallow */search/*/8
Disallow */search/*/9
Disallow */search/*/10

builtbottough

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

bytedancespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

alibabacloud

Rule Path
Disallow /

bytespyder

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.drnikhilshirsi.com/sitemap.xml

Comments

  • Powered by Boost360