abelard.org
robots.txt

Robots Exclusion Standard data for abelard.org

Resource Scan

Scan Details

Site Domain abelard.org
Base Domain abelard.org
Scan Status Ok
Last Scan2024-09-29T21:09:45+00:00
Next Scan 2024-10-06T21:09:45+00:00

Last Scan

Scanned2024-09-29T21:09:45+00:00
URL https://abelard.org/robots.txt
Redirect https://www.abelard.org/robots.txt
Redirect Domain www.abelard.org
Redirect Base abelard.org
Domain IPs 216.92.186.144
Redirect IPs 216.92.186.144
Response IP 216.92.186.144
Found Yes
Hash 662fd9bfbe4d4da9e1e61fab8d1a20b3f67996c6d1fd61174b84829567026f85
SimHash 632e73d0f711

Groups

mediapartners-google*

Rule Path
Disallow

*

Rule Path
Disallow /aspnet_client/
Disallow /_private/
Disallow /_vti_log/
Disallow /search/
Disallow /perform/
Disallow /painting/
Disallow /Templates/
Disallow /turpap2/tp2-image-version/
Disallow /turpap2/scanned/
Disallow /turpap2/check-image/
Disallow /images/
Disallow /buttons/
Disallow /cgi-bin/
Disallow /comments/
Disallow /common/
Disallow /database/
Disallow /errordocs/
Disallow /essaie/
Disallow /gifts/
Disallow /images/
Disallow /library/
Disallow /login/
Disallow /navbar/
Disallow /navbar2/
Disallow /phpsniff/
Disallow /sounds/
Disallow /promo/
Disallow /wordpress/
Disallow /mobile/

dotbot/1.1

Rule Path
Disallow /trap/

bingpreview/1.0b

Rule Path
Allow /w/api/
Disallow /trap/
Allow /w/api/
Disallow /trap/

linkpadbot/2.3

Rule Path
Allow /w/api/
Disallow /trap/

semrushbot

Rule Path
Disallow /trap/

blexbot/1.0

Rule Path
Allow /w/api/
Disallow /trap/

adsbot/3.1

Rule Path
Allow /w/api/
Disallow /trap/

petalbot

Rule Path
Allow /w/api/
Disallow /trap/

bingbot/2.0;

Rule Path
Allow /w/api/
Disallow /trap/

addthis.com

Rule Path
Allow /w/api/
Disallow /trap/

nl-leaseweb-20060223

Product Comment
nl-leaseweb-20060223 89.149.192.0 - 89.149.255.255
Rule Path
Allow /w/api/
Disallow /trap/

adsbot/3.1

Rule Path
Allow /w/api/
Disallow /trap/

barkrowler/0.9

Rule Path
Allow /w/api/
Disallow /trap/

googlebot-image/1.0

Rule Path
Allow /w/api/
Disallow /trap/

Other Records

Field Value
sitemap https://www.abelard.org/sitemap.xml

Comments

  • User-Agent: MegaIndex.ru/2.0