rapidcfl.com
robots.txt

Robots Exclusion Standard data for rapidcfl.com

Resource Scan

Scan Details

Site Domain rapidcfl.com
Base Domain rapidcfl.com
Scan Status Ok
Last Scan5/23/2025, 4:37:10 AM
Next Scan 5/30/2025, 4:37:10 AM

Last Scan

Scanned5/23/2025, 4:37:10 AM
URL https://rapidcfl.com/robots.txt
Redirect https://www.rapidcfl.com/robots.txt
Redirect Domain www.rapidcfl.com
Redirect Base rapidcfl.com
Domain IPs 72.52.204.224
Redirect IPs 72.52.204.224
Response IP 72.52.204.224
Found Yes
Hash 82240c6fa00dac19ed20ee2bce151b18dd355c1e18d4f136e4e24e23447df910
SimHash 5411c813c5f2

Groups

*

Rule Path
Disallow /cgi-bin/
Allow /

badbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.rapidcfl.com/sitemap.xml

Comments

  • Allow all search engines
  • Allow all other content to be crawled
  • Optionally, block other specific bots
  • Add a link to your sitemap for better indexing