tallahasseeconcretework.com
robots.txt

Robots Exclusion Standard data for tallahasseeconcretework.com

Resource Scan

Scan Details

Site Domain tallahasseeconcretework.com
Base Domain tallahasseeconcretework.com
Scan Status Ok
Last Scan2025-10-10T19:58:57+00:00
Next Scan 2025-10-17T19:58:57+00:00

Last Scan

Scanned2025-10-10T19:58:57+00:00
URL https://tallahasseeconcretework.com/robots.txt
Redirect https://www.tallahasseeconcretework.com/robots.txt
Redirect Domain www.tallahasseeconcretework.com
Redirect Base tallahasseeconcretework.com
Domain IPs 199.34.228.68
Redirect IPs 199.34.228.68
Response IP 199.34.228.68
Found Yes
Hash c086e7900f98414151233557f05170df501047e0c7ee6b695e5aa918362081f5
SimHash 486cdc54aff3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /blog.html
Disallow /1/
Disallow /blog/
Disallow /blog

Other Records

Field Value
sitemap https://www.tallahasseeconcretework.com/sitemap.xml