atom.com
robots.txt
Robots Exclusion Standard data for atom.com
Resource Scan
Scan Details
| Site Domain | atom.com |
| Base Domain | atom.com |
| Scan Status | Ok |
| Last Scan | 2024-09-12T15:26:12+00:00 |
| Next Scan | 2024-10-12T15:26:12+00:00 |
Last Scan
| Scanned | 2024-09-12T15:26:12+00:00 |
| URL | https://atom.com/robots.txt |
| Redirect | https://www.atom.com/robots.txt |
| Redirect Domain | www.atom.com |
| Redirect Base | atom.com |
| Domain IPs | 104.22.72.252, 104.22.73.252, 172.67.26.69, 2606:4700:10::6816:48fc, 2606:4700:10::6816:49fc, 2606:4700:10::ac43:1a45 |
| Redirect IPs | 104.22.72.252, 104.22.73.252, 172.67.26.69, 2606:4700:10::6816:48fc, 2606:4700:10::6816:49fc, 2606:4700:10::ac43:1a45 |
| Response IP | 172.67.26.69 |
| Found | Yes |
| Hash | 29e166660489d87f14c5423805d736739fb67a811b8156e351a4c6cbde60e08d |
| SimHash | fb8defcd5c57 |
Groups
mj12bot
*
| Rule | Path |
|---|---|
| Disallow | /cdn-cgi/mirage/* |
| Disallow | /*download.php |
| Disallow | /controllers/ |
| Disallow | /search_result_win.php*?* |
| Disallow | /sm/* |
| Disallow | /views/marketplace/* |
| Disallow | /controllers/* |
| Disallow | /lease-to-own/* |
| Disallow | /users/payment* |
| Disallow | /payments/* |
| Disallow | /testimonials-feedback/* |
| Disallow | /geo-business-names/* |
| Disallow | /business-name-generator/word/* |
| Disallow | /brand-alignment/* |
| Disallow | /User/* |
| Disallow | /our-work/* |
| Disallow | /Name-Ideas/name/* |
| Disallow | /-name-ideas/* |
| Disallow | /startups/* |
| Disallow | /logo-design-contest/* |
| Disallow | /app-name-ideas/* |
| Disallow | /domainContest/* |
| Disallow | /book-title-name-ideas/* |
| Disallow | /movie-name-ideas/* |
| Disallow | /manualpay.php/* |
| Disallow | /var/* |
| Disallow | /dashboard/* |
| Disallow | /ngtm/* |
| Disallow | /cb/* |
| Disallow | *tip-logo-designer* |
| Disallow | *.com/edit* |
| Disallow | *.org/edit* |
| Disallow | *.net/edit* |
| Disallow | *.io/edit* |
| Disallow | *.ai/edit* |
| Disallow | *.co/edit* |
| Disallow | *.app/edit* |
| Disallow | *.xyz/edit* |
| Disallow | *.vc/edit* |
| Disallow | *.gg/edit* |
| Disallow | *.ly/edit* |
| Disallow | /domain_audios/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.atom.com/blog/sitemap_index.xml |
| sitemap | https://www.atom.com/squadsitemap/domain-q-pages.xml |
| sitemap | https://www.atom.com/squadsitemap/auto-contest-index.xml |
| sitemap | https://www.atom.com/squadsitemap/auto-domains-index.xml |
| sitemap | https://www.atom.com/squadsitemap/auto-name-ideas-index.xml |
| sitemap | https://www.atom.com/squadsitemap/auto-domains_standard-index.xml |
| sitemap | https://www.atom.com/squadsitemap/auto-main.xml |
| sitemap | https://www.atom.com/squadsitemap/logo-design.xml |
| sitemap | https://www.atom.com/squadsitemap/domain-extensions.xml |