bodalgo.com
robots.txt
Robots Exclusion Standard data for bodalgo.com
Resource Scan
Scan Details
| Site Domain | bodalgo.com |
| Base Domain | bodalgo.com |
| Scan Status | Ok |
| Last Scan | 2024-09-09T14:32:27+00:00 |
| Next Scan | 2024-10-09T14:32:27+00:00 |
Last Scan
| Scanned | 2024-09-09T14:32:27+00:00 |
| URL | https://bodalgo.com/robots.txt |
| Redirect | https://www.bodalgo.com/robots.txt |
| Redirect Domain | www.bodalgo.com |
| Redirect Base | bodalgo.com |
| Domain IPs | 46.232.185.210 |
| Redirect IPs | 46.232.185.210 |
| Response IP | 46.232.185.210 |
| Found | Yes |
| Hash | 4c33b86ee14eb7190f190765564a52ad41bc368cbd20b0682e7bd5a6f1645f2e |
| SimHash | fb1e4612e8b0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */tag/* |
| Disallow | *RAND* |
| Disallow | */know-how/sprecher-finden-fuer-erklaervideos/20 |
barkrowler
mj12bot
petalbot
ahrefsbot
semrushbot
semrushbot-sa
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
semrushbot-seoab
serpstatbot
dataforseobot
semantic-visions
clark-crawler2
linguee
yandexbot
seekport crawler
neevabot
amazonbot
blackboard safeassign
blexbot/1.0
bytespider
crawler4j
dotbot
gigabot
liebaofast
mauibot
megaindex.ru/2.0
mqqbrowser
nimbostratus-bot/v1.3.2
seokicks
semrushbot
semrushbot-sa
seznambot
sputnikbot/2.3
the knowledge ai
turnitinbot
ucbrowser
yacybot
yeti
yisouspider
megaindex.ru/2.0
megaindex.ru
megaindex.ru
seekportbot
ccbot
awariorssbot
awariosmartbot
imagesiftbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bodalgo.com/de/sitemaps/index-de.xml |
| sitemap | https://www.bodalgo.com/en/sitemaps/index-en.xml |
| sitemap | https://www.bodalgo.com/es/sitemaps/index-es.xml |
| sitemap | https://www.bodalgo.com/fr/sitemaps/index-fr.xml |
| sitemap | https://www.bodalgo.com/it/sitemaps/index-it.xml |
| sitemap | https://www.bodalgo.com/pt/sitemaps/index-pt.xml |