mobeez.fr
robots.txt
Robots Exclusion Standard data for mobeez.fr
Resource Scan
Scan Details
| Site Domain | mobeez.fr |
| Base Domain | mobeez.fr |
| Scan Status | Ok |
| Last Scan | 2024-11-12T06:51:22+00:00 |
| Next Scan | 2024-11-19T06:51:22+00:00 |
Last Scan
| Scanned | 2024-11-12T06:51:22+00:00 |
| URL | https://mobeez.fr/robots.txt |
| Domain IPs | 104.16.150.108, 104.16.151.108, 2606:4700::6810:966c, 2606:4700::6810:976c |
| Response IP | 104.16.151.108 |
| Found | Yes |
| Hash | 03d90fb93208c445fe72cc0698f2d7afa3dc44aab20f8dbeb2e298e918bc32cf |
| SimHash | 79869821c4a0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
claudebot
claude-web
anthropic-ai
claude-web
ahrefsbot
aspiegelbot
blexbot
barkrowler
dotbot
mj12bot
petalbot
semrushbot
seznambot
sogou
serpstatbot
trendiction
textbulkerbot
| Rule | Path |
|---|---|
| Disallow | / |
ai2bot
ai2bot-dolma
anthropic-ai
bytespider
ccbot
chatgpt-user
claude-web
claudebot
cohere-ai
diffbot
duckassistbot
friendlycrawler
gptbot
iaskspider/2.0
icc-crawler
imagesiftbot
img2dataset
isscyberriskcrawler
kangaroo bot
oai-searchbot
omgili
omgilibot
perplexitybot
petalbot
scrapy
sidetrade indexer bot
timpibot
velenpublicwebcrawler
webzio-extended
youbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mobeez.fr/sitemap.xml |
| sitemap | https://www.mobeez.fr/sitemap-news.xml |
Warnings
- 1 invalid line.
Comments