Log In Sign Up

bdcrictime.com
robots.txt

Robots Exclusion Standard data for bdcrictime.com

Resource Scan

Scan Details

Site Domain bdcrictime.com
Base Domain bdcrictime.com
Scan Status Ok
Last Scan2024-10-02T07:40:33+00:00
Next Scan 2024-10-09T07:40:33+00:00

Last Scan

Scanned2024-10-02T07:40:33+00:00
URL https://bdcrictime.com/robots.txt
Domain IPs 51.79.228.108
Response IP 51.79.228.108
Found Yes
Hash 6691288e9bafbefcbb5332282dad895625b8edb84cbb11ada40e7463c3bb56e2
SimHash eb14db906f40

Groups

nerdbynature.bot

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

spanner

Rule Path
Disallow /

harvest/1.5

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

mata hari

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

the intraformant

Rule Path
Disallow /

true_robot/1.0

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

webster pro

Rule Path
Disallow /

*

Rule Path
Disallow /services/tablet/

ahrefsbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://bdcrictime.com/sitemap.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top