benmarshall.me
robots.txt

Robots Exclusion Standard data for benmarshall.me

Resource Scan

Scan Details

Site Domain benmarshall.me
Base Domain benmarshall.me
Scan Status Ok
Last Scan2025-12-27T01:50:46+00:00
Next Scan 2026-01-03T01:50:46+00:00

Last Scan

Scanned2025-12-27T01:50:46+00:00
URL https://benmarshall.me/robots.txt
Domain IPs 34.120.190.48, 34.149.120.3, 35.227.194.51, 35.244.153.44
Response IP 34.160.81.203
Found Yes
Hash c393548f2098d6f42e4d1fb720a9be5b7728d90f504c53f75a0689a710c2a54f
SimHash 9d204880a81a

Groups

*

Rule Path
Disallow /wp-json/
Disallow /?rest_route=

Other Records

Field Value
sitemap https://benmarshall.me/sitemap.xml
sitemap https://benmarshall.me/news-sitemap.xml
sitemap https://benmarshall.me/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK