duocircle.com
robots.txt

Robots Exclusion Standard data for duocircle.com

Resource Scan

Scan Details

Site Domain duocircle.com
Base Domain duocircle.com
Scan Status Ok
Last Scan2024-09-24T13:43:44+00:00
Next Scan 2024-10-24T13:43:44+00:00

Last Scan

Scanned2024-09-24T13:43:44+00:00
URL https://duocircle.com/robots.txt
Domain IPs 162.159.135.42
Response IP 162.159.135.42
Found Yes
Hash 1f8c02fcb1f95b058a5fe0f279954ba88ddc9cd4275e5fa653fd8c6bb9d9912f
SimHash c0009a2223a2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Disallow /blog/tag/
Allow /wp-admin/admin-ajax.php