oloc7.x.incapdns.net
robots.txt

Robots Exclusion Standard data for oloc7.x.incapdns.net

Resource Scan

Scan Details

Site Domain oloc7.x.incapdns.net
Base Domain incapdns.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-20T02:19:27+00:00
Next Scan 2024-07-19T02:19:27+00:00

Last Successful Scan

Scanned2023-08-31T22:08:08+00:00
URL http://oloc7.x.incapdns.net/robots.txt
Redirect https://www.americanbar.org/robots.txt
Redirect Domain www.americanbar.org
Redirect Base americanbar.org
Domain IPs 45.60.126.186
Redirect IPs 104.18.95.178, 104.18.96.178, 2606:4700::6812:5fb2, 2606:4700::6812:60b2
Response IP 104.18.95.178
Found Yes
Hash b4840e935b8a413f72485b1b4b48681cf3a948be66352308d9793d702ef46185
SimHash 7002865a4727

Groups

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

twitterbot

Rule Path
Allow /content/dam/

facebot

Rule Path
Allow /content/dam/

*

Rule Path
Allow /content/dam/aba-cms-dotorg/products/
Allow /content/dam/aba/root
Allow /content/dam/aba/publications
Allow /content/dam/aba/publishing
Disallow /tools/
Disallow /errors/
Disallow /sandbox/
Disallow /test/
Disallow /directories/
Disallow /auth/
Disallow /claim/
Disallow /my-aba/
Disallow /join/
Disallow /checkout/
Disallow /cart/
Disallow /content/dam/
Disallow /content/dam/aba/administrative/aba/cyberalert/
Disallow /content/dam/aba/administrative/cyberalert/
Disallow /content/dam/aba/administrative/aba/ransomware.pdf
Disallow /content/dam/aba/administrative/aba/ransomware.authcheckdam.pdf
Disallow /events-cle/mtg/inviteonly/
Disallow /profile*

Other Records

Field Value
sitemap https://www.americanbar.org/content/dam/aba/root/sitemap.gz
sitemap https://www.americanbar.org/content/dam/aba/root/sitemap2.gz