awebdesign.ro
robots.txt

Robots Exclusion Standard data for awebdesign.ro

Resource Scan

Scan Details

Site Domain awebdesign.ro
Base Domain awebdesign.ro
Scan Status Ok
Last Scan2025-05-19T02:43:46+00:00
Next Scan 2025-06-18T02:43:46+00:00

Last Scan

Scanned2025-05-19T02:43:46+00:00
URL https://awebdesign.ro/robots.txt
Redirect https://www.awebdesign.ro/robots.txt
Redirect Domain www.awebdesign.ro
Redirect Base awebdesign.ro
Domain IPs 146.19.133.232
Redirect IPs 146.19.133.232
Response IP 146.19.133.232
Found Yes
Hash f91fcafd40e837833a4f4cbd356d21abcc1d27a6bf18c5b4d783858562da408b
SimHash 4000da0243b2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php