bhargava.me
robots.txt

Robots Exclusion Standard data for bhargava.me

Resource Scan

Scan Details

Site Domain bhargava.me
Base Domain bhargava.me
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/25/2025, 4:13:17 PM
Next Scan 5/26/2025, 4:13:17 PM

Last Successful Scan

Scanned4/25/2025, 4:13:05 PM
URL https://bhargava.me/robots.txt
Domain IPs 104.21.49.98, 172.67.161.155, 2606:4700:3031::6815:3162, 2606:4700:3036::ac43:a19b
Response IP 104.21.49.98
Found Yes
Hash 0bc80ab268a8f179b890152da17ad787bcb13fd33545a4d4532a701fadf46b5a
SimHash 6a01cc00af92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://bhargava.me/sitemap.xml
sitemap https://bhargava.me/news-sitemap.xml