bikroy.com
robots.txt

Robots Exclusion Standard data for bikroy.com

Resource Scan

Scan Details

Site Domain bikroy.com
Base Domain bikroy.com
Scan Status Ok
Last Scan2024-06-12T00:22:30+00:00
Next Scan 2024-06-19T00:22:30+00:00

Last Scan

Scanned2024-06-12T00:22:30+00:00
URL https://bikroy.com/robots.txt
Domain IPs 104.22.58.241, 104.22.59.241, 172.67.42.154, 2606:4700:10::6816:3af1, 2606:4700:10::6816:3bf1, 2606:4700:10::ac43:2a9a
Response IP 104.22.59.241
Found Yes
Hash 6061f4315a4a134e4cceb93a07cc3f45835797016b9ccad7bd1c6df4e7706685
SimHash 110cfccad935

Groups

mediapartners-google

Rule Path
Disallow

bdnews24.com

Rule Path
Disallow

*
*

Rule Path
Disallow /*utm_source*
Disallow /*?*c=*
Disallow /*?*account=*
Disallow /*?*filters=*
Disallow /*?*sort=*
Disallow /*?*type=*
Disallow /*?*query=*
Disallow /*/ad/*/delete*
Disallow /*/ad/*/edit*
Disallow /*/ad/*/report*
Disallow /*/password-reset*
Disallow /*/password-update
Disallow /*--*
Disallow /*/ads-locations*
Disallow /*/ads-categories*
Disallow /*/ads-filters*
Disallow /*/ads-type*
Disallow /134461134/
Allow /*item_type%3D*
Disallow */confirm
Disallow */promote
Disallow */payment/transaction
Disallow */promote/voucher
Disallow */select-payment

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://bikroy.com/sitemap-index-new.xml
sitemap https://bikroy.com/sitemap-serp-index.xml
sitemap https://bikroy.com/sitemap-listings-index.xml
sitemap https://blog.bikroy.com/sitemap_index.xml
sitemap https://bnblog.bikroy.com/sitemap_index.xml

Comments

  • Sitemap
  • Excludes
  • Blog
  • Promotions
  • msn