agentakash.com
robots.txt

Robots Exclusion Standard data for agentakash.com

Resource Scan

Scan Details

Site Domain agentakash.com
Base Domain agentakash.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-22T08:07:11+00:00
Next Scan 2026-01-21T08:07:11+00:00

Last Successful Scan

Scanned2025-08-31T18:51:24+00:00
URL https://agentakash.com/robots.txt
Redirect https://www.agentakash.com/robots.txt
Redirect Domain www.agentakash.com
Redirect Base agentakash.com
Domain IPs 2a02:4780:84:c478:a4ff:8dc5:3ec2:eeb2, 2a02:4780:84:ec7c:54cc:4260:6582:d584, 84.32.84.124, 84.32.84.207
Redirect IPs 2a02:4780:15:31b6:6c15:81c0:f731:ba05, 2a02:4780:38:f799:a9ef:35b3:15d5:ce4a, 84.32.84.144, 84.32.84.50
Response IP 77.37.75.133
Found Yes
Hash 4061d9eec851718d86bd3fff0089aa7fce154b980e4a6f1e5e13e2e16260aad7
SimHash 4a095c508a93

Groups

*

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 15

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.agentakash.com/sitemap_index.xml