bdcricteam.com
robots.txt

Robots Exclusion Standard data for bdcricteam.com

Resource Scan

Scan Details

Site Domain bdcricteam.com
Base Domain bdcricteam.com
Scan Status Ok
Last Scan2024-11-09T09:23:42+00:00
Next Scan 2024-11-16T09:23:42+00:00

Last Scan

Scanned2024-11-09T09:23:42+00:00
URL https://bdcricteam.com/robots.txt
Redirect https://bdcrictime.com/robots.txt
Redirect Domain bdcrictime.com
Redirect Base bdcrictime.com
Domain IPs 104.21.21.66, 172.67.196.206, 2606:4700:3030::ac43:c4ce, 2606:4700:3037::6815:1542
Redirect IPs 51.79.228.108
Response IP 51.79.228.108
Found Yes
Hash 6691288e9bafbefcbb5332282dad895625b8edb84cbb11ada40e7463c3bb56e2
SimHash eb14db906f40

Groups

nerdbynature.bot

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

spanner

Rule Path
Disallow /

harvest/1.5

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

mata hari

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

the intraformant

Rule Path
Disallow /

true_robot/1.0

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

webster pro

Rule Path
Disallow /

*

Rule Path
Disallow /services/tablet/

ahrefsbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bdcrictime.com/sitemap.xml

Warnings

  • 2 invalid lines.