coditools.com
robots.txt

Robots Exclusion Standard data for coditools.com

Resource Scan

Scan Details

Site Domain coditools.com
Base Domain coditools.com
Scan Status Ok
Last Scan2025-09-02T15:51:43+00:00
Next Scan 2025-09-09T15:51:43+00:00

Last Scan

Scanned2025-09-02T15:51:43+00:00
URL https://coditools.com/robots.txt
Redirect https://www.coditools.com/robots.txt
Redirect Domain www.coditools.com
Redirect Base coditools.com
Domain IPs 66.29.153.184
Redirect IPs 162.0.212.2
Response IP 162.0.212.2
Found Yes
Hash 35d90e4527fa54670a8cda4cbaead2b9d4cd0d215c048d5529cd470cba60cbe5
SimHash 6b0a50b1c5b5

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

whatsapp

Rule Path
Allow /

applebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://coditools.com/sitemap.xml