abcbourse.com
robots.txt

Robots Exclusion Standard data for abcbourse.com

Resource Scan

Scan Details

Site Domain abcbourse.com
Base Domain abcbourse.com
Scan Status Ok
Last Scan2024-06-29T03:03:27+00:00
Next Scan 2024-07-06T03:03:27+00:00

Last Scan

Scanned2024-06-29T03:03:27+00:00
URL https://abcbourse.com/robots.txt
Redirect https://www.abcbourse.com/robots.txt
Redirect Domain www.abcbourse.com
Redirect Base abcbourse.com
Domain IPs 212.129.46.230
Redirect IPs 212.129.46.230
Response IP 212.129.46.230
Found Yes
Hash 581d6ce09ed0131481f6df9c194838facbfc3bbcb1ee6457cbab229848de53d4
SimHash f74c71400d91

Groups

*

Rule Path
Disallow /abcquote/
Disallow /boutique/cart
Disallow /forums/profile/*
Disallow /forums/post
Disallow /users/

magpie-crawler

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot
awariorssbot
awariosmartbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

yak

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

proximic

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

amazonbot

Product Comment
amazonbot Amazon's user agent (Alexa...)
Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.abcbourse.com/sitemap

Comments

  • robots.txt pour www.abcbourse.com
  • Brandwatch
  • ubermetrics-technologies.com
  • Majestic
  • Linkfluence
  • Talkwalkers
  • Ads
  • AI