static.atomy.com
robots.txt

Robots Exclusion Standard data for static.atomy.com

Resource Scan

Scan Details

Site Domain static.atomy.com
Base Domain atomy.com
Scan Status Ok
Last Scan2024-11-05T21:26:42+00:00
Next Scan 2024-11-19T21:26:42+00:00

Last Scan

Scanned2024-11-05T21:26:42+00:00
URL https://static.atomy.com/robots.txt
Domain IPs 3.165.102.26, 3.165.102.3, 3.165.102.7, 3.165.102.98
Response IP 3.165.102.98
Found Yes
Hash 315400cf967133f0c372c088f841d9de589c51c7f8736f8b19b72cefc4c8aca0
SimHash 4a504f992fd5

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 10 10 seconds between page requests

Other Records

Field Value
sitemap https://m.atomy.com/sitemap.xml
sitemap https://m.atomy.com/jp/sitemap.xml
sitemap https://m.atomy.com/tw/sitemap.xml
sitemap https://m.atomy.com/sg/sitemap.xml
sitemap https://m.atomy.com/kh/sitemap.xml
sitemap https://m.atomy.com/ph/sitemap.xml
sitemap https://m.atomy.com/my/sitemap.xml
sitemap https://m.atomy.com/th/sitemap.xml
sitemap https://m.atomy.com/au/sitemap.xml
sitemap https://m.atomy.com/id/sitemap.xml
sitemap https://m.atomy.com/in/sitemap.xml
sitemap https://m.atomy.com/hk/sitemap.xml
sitemap https://m.atomy.com/nz/sitemap.xml
sitemap https://m.atomy.com/mn/sitemap.xml
sitemap https://m.atomy.kz/kz/sitemap.xml
sitemap https://m.atomy.kg/kg/sitemap.xml
sitemap https://m.atomy.uz/uz/sitemap.xml
sitemap https://m.atomy.com/tr/sitemap.xml
sitemap https://m.atomy.uk/uk/sitemap.xml
sitemap https://m.atomy.com/mx/sitemap.xml
sitemap https://m.atomy.com/co/sitemap.xml
sitemap https://m.atomy.com/br/sitemap.xml
sitemap https://m.atomy.com/us/sitemap.xml
sitemap https://m.atomy.com/ca/sitemap.xml

Comments

  • For all robots
  • Block access to specific groups of pages
  • Allow search crawlers to discover the sitemap

Warnings

  • 3 invalid lines.
  • `request-rate` is not a known field.