completemarkets.com
robots.txt
Robots Exclusion Standard data for completemarkets.com
Resource Scan
Scan Details
Site Domain | completemarkets.com |
Base Domain | completemarkets.com |
Scan Status | Ok |
Last Scan | 2024-09-27T07:07:04+00:00 |
Next Scan | 2024-10-27T07:07:04+00:00 |
Last Scan
Scanned | 2024-09-27T07:07:04+00:00 |
URL | https://completemarkets.com/robots.txt |
Domain IPs | 172.66.40.233, 172.66.43.23, 2606:4700:3108::ac42:28e9, 2606:4700:3108::ac42:2b17 |
Response IP | 172.66.40.233 |
Found | Yes |
Hash | 6dfd15ad10081700feadc3ce6bf1c465201c1bee98a1f94d149dff91d6d3311e |
SimHash | 627edb5148f3 |
Groups
yandex
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Disallow | */TabVisibility? |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
mj12bot
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
ahrefsbot
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
dotbot
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
spbot
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
seznambot
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
addthis
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
bot
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
memorybot
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
linkdexbot
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
konqueror
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
exabot
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
voilabot
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
facebookexternalhit
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
turnitinbot
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
msnbot
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | */submission? |
msnbot-products
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
msnbot-media
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | /Membership/Register.aspx |
Disallow | */submission? |
*
Rule | Path |
---|---|
Disallow | /lh.ashx |
Disallow | /adrotator.aspx |
Disallow | /picturehandler.ashx |
Disallow | /adhandler.ashx |
Disallow | /inquiry |
Disallow | /Support/ |
Disallow | /support/ |
Disallow | /Pages/SocialLogin/ |
Disallow | */submission? |
Disallow | */%26up_ordinals%3D0%2C1%2C2%2C3%2C4?%2C5%2C6%2C7%2C8%2C9 |
Disallow | /WebServices/ |
Disallow | */www.w3.org/* |
Other Records
Field | Value |
---|---|
sitemap | https://completemarkets.com/SiteMap/Sitemap.xml |
sitemap | https://completemarkets.com/SiteMap/coveragesearchsitemap.xml |
sitemap | https://completemarkets.com/SiteMap/ConsumerArticles.xml |
sitemap | https://completemarkets.com/SiteMap/NRStorefronts.xml |
Comments