meritas.org
robots.txt

Robots Exclusion Standard data for meritas.org

Resource Scan

Scan Details

Site Domain meritas.org
Base Domain meritas.org
Scan Status Ok
Last Scan2024-05-01T05:39:40+00:00
Next Scan 2024-05-31T05:39:40+00:00

Last Scan

Scanned2024-05-01T05:39:40+00:00
URL https://meritas.org/robots.txt
Domain IPs 104.26.0.139, 104.26.1.139, 172.67.68.60, 2606:4700:20::681a:18b, 2606:4700:20::681a:8b, 2606:4700:20::ac43:443c
Response IP 172.67.68.60
Found Yes
Hash 622c81d5bd6f302e06c80e487dd9519dc97916a734bc56a42b13b5922da2d274
SimHash 4900d472c791

Groups

swiftbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 4

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.meritas.org/sitemap.xml