atomy.com
robots.txt

Robots Exclusion Standard data for atomy.com

Resource Scan

Scan Details

Site Domain atomy.com
Base Domain atomy.com
Scan Status Ok
Last Scan2024-10-28T02:58:07+00:00
Next Scan 2024-11-27T02:58:07+00:00

Last Scan

Scanned2024-10-28T02:58:07+00:00
URL https://atomy.com/robots.txt
Redirect https://www.atomy.com/robots.txt
Redirect Domain www.atomy.com
Redirect Base atomy.com
Domain IPs 13.209.231.43
Redirect IPs 13.209.231.43
Response IP 13.209.231.43
Found Yes
Hash b4ec8e40a87aa2e1d8065575f138ec967e1716d0d0b30c4adff9c3e658965794
SimHash 6c301f5969e5

Groups

*

Rule Path
Disallow /*/admin/
Disallow /*/homeadmin/

Other Records

Field Value Comment
crawl-delay 10 10 seconds between page requests

Other Records

Field Value
sitemap https://www.atomy.com/jp/sitemap.xml
sitemap https://www.atomy.com/tw/sitemap.xml
sitemap https://www.atomy.com/sg/sitemap.xml
sitemap https://www.atomy.com/kh/sitemap.xml
sitemap https://www.atomy.com/ph/sitemap.xml
sitemap https://www.atomy.com/my/sitemap.xml
sitemap https://www.atomy.com/th/sitemap.xml
sitemap https://www.atomy.com/au/sitemap.xml
sitemap https://www.atomy.com/id/sitemap.xml
sitemap https://www.atomy.com/in/sitemap.xml
sitemap https://www.atomy.com/hk/sitemap.xml
sitemap https://www.atomy.com/nz/sitemap.xml
sitemap https://www.atomy.com/mn/sitemap.xml
sitemap https://www.atomy.com/tr/sitemap.xml
sitemap https://www.atomy.com/mx/sitemap.xml
sitemap https://www.atomy.com/co/sitemap.xml
sitemap https://www.atomy.com/br/sitemap.xml
sitemap https://www.atomy.com/us/sitemap.xml
sitemap https://www.atomy.com/ca/sitemap.xml

Comments

  • For all robots
  • Block access to specific groups of pages
  • Allow search crawlers to discover the sitemap

Warnings

  • 4 invalid lines.
  • `request-rate` is not a known field.