webcodegeeks.com
robots.txt

Robots Exclusion Standard data for webcodegeeks.com

Resource Scan

Scan Details

Site Domain webcodegeeks.com
Base Domain webcodegeeks.com
Scan Status Ok
Last Scan2025-08-25T13:58:23+00:00
Next Scan 2025-09-01T13:58:23+00:00

Last Scan

Scanned2025-08-25T13:58:23+00:00
URL https://webcodegeeks.com/robots.txt
Domain IPs 104.21.16.175, 172.67.214.229, 2606:4700:3031::ac43:d6e5, 2606:4700:3033::6815:10af
Response IP 104.21.16.175
Found Yes
Hash e8a7aaa7229e618aeaec0931e2ded6736b1a55cd3e39eb99dea93475e0770372
SimHash 60008a0263a2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

bingbot

Rule Path
Disallow /