atomy.com
robots.txt
Robots Exclusion Standard data for atomy.com
Resource Scan
Scan Details
Site Domain | atomy.com |
Base Domain | atomy.com |
Scan Status | Ok |
Last Scan | 2024-10-28T02:58:07+00:00 |
Next Scan | 2024-11-27T02:58:07+00:00 |
Last Scan
Scanned | 2024-10-28T02:58:07+00:00 |
URL | https://atomy.com/robots.txt |
Redirect | https://www.atomy.com/robots.txt |
Redirect Domain | www.atomy.com |
Redirect Base | atomy.com |
Domain IPs | 13.209.231.43 |
Redirect IPs | 13.209.231.43 |
Response IP | 13.209.231.43 |
Found | Yes |
Hash | b4ec8e40a87aa2e1d8065575f138ec967e1716d0d0b30c4adff9c3e658965794 |
SimHash | 6c301f5969e5 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/admin/ |
Disallow | /*/homeadmin/ |
Other Records
Field | Value | Comment |
---|---|---|
crawl-delay | 10 | 10 seconds between page requests |
Other Records
Field | Value |
---|---|
sitemap | https://www.atomy.com/jp/sitemap.xml |
sitemap | https://www.atomy.com/tw/sitemap.xml |
sitemap | https://www.atomy.com/sg/sitemap.xml |
sitemap | https://www.atomy.com/kh/sitemap.xml |
sitemap | https://www.atomy.com/ph/sitemap.xml |
sitemap | https://www.atomy.com/my/sitemap.xml |
sitemap | https://www.atomy.com/th/sitemap.xml |
sitemap | https://www.atomy.com/au/sitemap.xml |
sitemap | https://www.atomy.com/id/sitemap.xml |
sitemap | https://www.atomy.com/in/sitemap.xml |
sitemap | https://www.atomy.com/hk/sitemap.xml |
sitemap | https://www.atomy.com/nz/sitemap.xml |
sitemap | https://www.atomy.com/mn/sitemap.xml |
sitemap | https://www.atomy.com/tr/sitemap.xml |
sitemap | https://www.atomy.com/mx/sitemap.xml |
sitemap | https://www.atomy.com/co/sitemap.xml |
sitemap | https://www.atomy.com/br/sitemap.xml |
sitemap | https://www.atomy.com/us/sitemap.xml |
sitemap | https://www.atomy.com/ca/sitemap.xml |
Warnings
- 4 invalid lines.
- `request-rate` is not a known field.
Comments