aiomag.com
robots.txt
Robots Exclusion Standard data for aiomag.com
Resource Scan
Scan Details
Site Domain | aiomag.com |
Base Domain | aiomag.com |
Scan Status | Ok |
Last Scan | 2024-09-19T16:14:17+00:00 |
Next Scan | 2024-09-26T16:14:17+00:00 |
Last Scan
Scanned | 2024-09-19T16:14:17+00:00 |
URL | http://www.aiomag.com/robots.txt |
Domain IPs | 2404:6800:4003:c11::79, 74.125.200.121 |
Response IP | 142.251.12.121 |
Found | Yes |
Hash | 17920f760140d0e0f8a93bd16aba014d31c6854dac01c91087278f98f316ac63 |
SimHash | 2c54c6125483 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /cgi-bin/ |
*
Rule | Path |
---|---|
Disallow | /search |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.aiomag.com/sitemap.xml |
sitemap | http://www.aiomag.com/sitemap.xml |
sitemap | https://www.aiomag.com/atom.xml?redirect=false&start-index=1&max-results=500 |
sitemap | http://www.aiomag.com/atom.xml?redirect=false&start-index=1&max-results=500 |
sitemap | https://www.aiomag.com/atom.xml |
sitemap | http://www.aiomag.com/atom.xml |
sitemap | https://aiomagblog.blogspot.com/sitemap.xml |
sitemap | http://aiomagblog.blogspot.com/sitemap.xml |
sitemap | https://www.aiomag.com/feeds/posts/default?orderby=UPDATED |
sitemap | http://www.aiomag.com/feeds/posts/default?orderby=UPDATED |
sitemap | http://www.aiomag.com/feeds/posts/default?orderby=UPDATED |
sitemap | https://aiomagblog.blogspot.com/feeds/posts/default?orderby=UPDATED |
sitemap | http://aiomagblog.blogspot.com/feeds/posts/default?orderby=UPDATED |