arewatechblog.com
robots.txt

Robots Exclusion Standard data for arewatechblog.com

Resource Scan

Scan Details

Site Domain arewatechblog.com
Base Domain arewatechblog.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-07T19:53:28+00:00
Next Scan 2025-12-21T19:53:28+00:00

Last Successful Scan

Scanned2025-11-22T00:43:08+00:00
URL https://arewatechblog.com/robots.txt
Domain IPs 162.0.229.231
Response IP 162.0.229.231
Found Yes
Hash 094e030c87080a0f20f866e0e5c130e74044b81804186f24e6970913cfadb10a
SimHash 410118000f92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://arewatechblog.com/sitemap_index.xml