thegeek.site
robots.txt

Robots Exclusion Standard data for thegeek.site

Resource Scan

Scan Details

Site Domain thegeek.site
Base Domain thegeek.site
Scan Status Ok
Last Scan2025-11-16T16:35:26+00:00
Next Scan 2025-11-23T16:35:26+00:00

Last Scan

Scanned2025-11-16T16:35:26+00:00
URL https://thegeek.site/robots.txt
Domain IPs 172.66.40.149, 172.66.43.107, 2606:4700:3108::ac42:2895, 2606:4700:3108::ac42:2b6b
Response IP 172.66.40.149
Found Yes
Hash 6a667daef6501746f964806b9387aa95e35cba506f33e6d612f8672b9e9e3970
SimHash d21cc862eba0

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseo-bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /