thinkdataanalytics.com
robots.txt

Robots Exclusion Standard data for thinkdataanalytics.com

Resource Scan

Scan Details

Site Domain thinkdataanalytics.com
Base Domain thinkdataanalytics.com
Scan Status Ok
Last Scan2025-09-29T02:15:58+00:00
Next Scan 2025-10-06T02:15:58+00:00

Last Scan

Scanned2025-09-29T02:15:58+00:00
URL https://thinkdataanalytics.com/robots.txt
Domain IPs 35.213.138.76
Response IP 35.213.138.76
Found Yes
Hash c68f5b98a0a4f97b790a308a359f16be686ec4b442d20210639dbde1e3f2618d
SimHash d83888226b23

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu’s

Rule Path
Disallow /

xenu’s link sleuth 1.1c

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /