frontiersin.org
robots.txt
Robots Exclusion Standard data for frontiersin.org
Resource Scan
Scan Details
Site Domain | frontiersin.org |
Base Domain | frontiersin.org |
Scan Status | Ok |
Last Scan | 2025-06-15T05:18:01+00:00 |
Next Scan | 2025-07-15T05:18:01+00:00 |
Last Scan
Scanned | 2025-06-15T05:18:01+00:00 |
URL | https://frontiersin.org/robots.txt |
Redirect | https://www.frontiersin.org/robots.txt |
Redirect Domain | www.frontiersin.org |
Redirect Base | frontiersin.org |
Domain IPs | 20.105.75.30 |
Redirect IPs | 13.107.253.59, 2620:1ec:29:1::59 |
Response IP | 13.107.253.59 |
Found | Yes |
Hash | 2c22968654ba3369a8025540ddd15985e2906efeb2bef41bf8d796b0edc8c596 |
SimHash | e1011dce46d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /images/ |
Disallow | /Images/ |
Disallow | /production/ |
Disallow | /Production/ |
Disallow | /review/ |
Disallow | /Review/ |
Disallow | /mail/ |
Disallow | /Mail/ |
Disallow | /admin/ |
Disallow | /Admin/ |
Disallow | /journals/testfieldhumanities/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.frontiersin.org/sitemap.xml |
sitemap | https://kids.frontiersin.org/sitemap.xml |
sitemap | https://www.frontiersin.org/articles/sitemap-index.xml |
sitemap | https://coronavirus.frontiersin.org/sitemap.xml |
sitemap | https://www.frontiersin.org/sitemap-journals.xml |
sitemap | https://www.frontiersin.org/sitemap-home.xml |
sitemap | https://www.frontiersin.org/sitemap-article-pages-2022.xml |
sitemap | https://www.frontiersin.org/sitemap-magazines.xml |
sitemap | https://www.frontiersin.org/sitemap-science-news.xml |
sitemap | https://careers.frontiersin.org/sitemap.xml |