corepartners.org
robots.txt

Robots Exclusion Standard data for corepartners.org

Resource Scan

Scan Details

Site Domain corepartners.org
Base Domain corepartners.org
Scan Status Ok
Last Scan2024-09-27T13:46:48+00:00
Next Scan 2024-10-04T13:46:48+00:00

Last Scan

Scanned2024-09-27T13:46:48+00:00
URL https://corepartners.org/robots.txt
Redirect https://www.corepartners.org/robots.txt
Redirect Domain www.corepartners.org
Redirect Base corepartners.org
Domain IPs 50.28.98.204
Redirect IPs 50.28.98.204
Response IP 50.28.98.204
Found Yes
Hash 17f457baf93765e943a64db90fadb2862a95135a1783b3f52e4fe7ec625b563c
SimHash 210089854697

Groups

mediapartners-google

Rule Path
Disallow

architextspider
baiduspider
googlebot
googlebot-image
mediapartners-google
msnbot
msnbot-media
yahoo-blogs
yahoo-mmcrawler
slurp
bingbot

Rule Path
Allow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.corepartners.org/tech/sitemap-category.xml
sitemap https://www.corepartners.org/money/sitemap-category.xml
sitemap https://www.corepartners.org/legal/sitemap-category.xml
sitemap https://www.corepartners.org/marriage/sitemap-category.xml
sitemap https://www.corepartners.org/food/sitemap-category.xml
sitemap https://www.corepartners.org/health/sitemap-category.xml
sitemap https://www.corepartners.org/bid/sitemap-category.xml

Comments

  • allow only important bots