atlasportal.org
robots.txt

Robots Exclusion Standard data for atlasportal.org

Resource Scan

Scan Details

Site Domain atlasportal.org
Base Domain atlasportal.org
Scan Status Ok
Last Scan2024-09-01T22:56:46+00:00
Next Scan 2024-10-01T22:56:46+00:00

Last Scan

Scanned2024-09-01T22:56:46+00:00
URL https://atlasportal.org/robots.txt
Domain IPs 3.164.85.117, 3.164.85.129, 3.164.85.37, 3.164.85.99
Response IP 52.85.49.26
Found Yes
Hash 61f075db3e1616442e3a9135c419ff1b5b35bf34e97d8fd3fc61ec85672c2868
SimHash a0195001c4b5

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /static/
Disallow /assets/
Disallow /feeds/
Allow /

facebookexternalhit

Rule Path
Disallow /static/
Disallow /assets/
Disallow /feeds/
Allow /

yahoo-mmcrawler

Rule Path
Disallow /static/
Disallow /assets/
Disallow /feeds/
Allow /

yahoo-blogs

Rule Path
Disallow /static/
Disallow /assets/
Disallow /feeds/
Allow /

twitterbot

Rule Path
Disallow /static/
Disallow /assets/
Disallow /feeds/
Allow /

amazon-kendra

Rule Path
Disallow /static/
Disallow /assets/
Disallow /feeds/
Allow /

linkedinbot

Rule Path
Disallow /static/
Disallow /assets/
Disallow /feeds/
Allow /

bingbot

Rule Path
Disallow /static/
Disallow /assets/
Disallow /feeds/
Allow /

msnbot

Rule Path
Disallow /static/
Disallow /assets/
Disallow /feeds/
Allow /

Other Records

Field Value
sitemap https://atlasportal.org/sitemap.xml