aimlay.com
robots.txt

Robots Exclusion Standard data for aimlay.com

Resource Scan

Scan Details

Site Domain aimlay.com
Base Domain aimlay.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-10T12:09:30+00:00
Next Scan 2026-02-08T12:09:30+00:00

Last Successful Scan

Scanned2025-06-19T17:21:54+00:00
URL https://aimlay.com/robots.txt
Domain IPs 191.101.228.229, 2a02:4780:38:aaa2:c93d:c249:eea2:4063, 2a02:4780:39:a71b:8742:f892:1ad3:3c2d, 77.37.75.38
Response IP 77.37.115.27
Found Yes
Hash 60fbf5c7aca2f284e71562b2fdf372167f46ac412cfaf9b1739248fae3e85a9e
SimHash ec145912e5a9

Groups

*

Rule Path
Allow /tag/
Allow /category/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow /cdn-cgi/
Disallow /wp-content/uploads/wpo-plugins-tables-list.json

Other Records

Field Value
sitemap https://www.aimlay.com/sitemap.xml

Comments

  • Allow Google to index tags and posts
  • Prevent crawling of duplicate content or non-essential URLs (optional)

Warnings

  • 1 invalid line.