amphibiaweb.org
robots.txt

Robots Exclusion Standard data for amphibiaweb.org

Resource Scan

Scan Details

Site Domain amphibiaweb.org
Base Domain amphibiaweb.org
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-24T16:15:11+00:00
Next Scan 2024-10-23T16:15:11+00:00

Last Successful Scan

Scanned2024-06-03T15:39:11+00:00
URL https://amphibiaweb.org/robots.txt
Domain IPs 128.32.213.157
Response IP 128.32.213.157
Found Yes
Hash e39688f0735f104b8ea7b936bbbd7b9fd45976a6caa430d350ff95da3e416175
SimHash 04506d18c553

Groups

siteimprovebot

Rule Path
Disallow /cgi/amphib_query
Disallow /cgi/aw_people_query

siteimprovebot-crawler

Rule Path
Disallow /cgi/amphib_query
Disallow /cgi/aw_people_query

sitecheck-sitecrawl by siteimprove.com

Rule Path
Disallow /cgi/amphib_query
Disallow /cgi/aw_people_query

linkcheck by siteimprove.com

Rule Path
Disallow /cgi/amphib_query
Disallow /cgi/aw_people_query

image size by siteimprove.com

Rule Path
Disallow /cgi/amphib_query
Disallow /cgi/aw_people_query

probe by siteimprove.com

Rule Path
Disallow /cgi/amphib_query
Disallow /cgi/aw_people_query