fajobe.com.co
robots.txt
Robots Exclusion Standard data for fajobe.com.co
Resource Scan
Scan Details
| Site Domain | fajobe.com.co |
| Base Domain | fajobe.com.co |
| Scan Status | Ok |
| Last Scan | 2024-11-08T11:36:29+00:00 |
| Next Scan | 2024-12-08T11:36:29+00:00 |
Last Scan
| Scanned | 2024-11-08T11:36:29+00:00 |
| URL | https://fajobe.com.co/robots.txt |
| Domain IPs | 179.61.189.163, 2a02:4780:16:d7c3:38b7:c47f:7350:2fd5 |
| Response IP | 91.108.100.216 |
| Found | Yes |
| Hash | c4f36e7444c9035d32d6d6efaf6b4d9c18b174af972a630cd88e00aeccc97c08 |
| SimHash | 38184a80e6b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /gracias |
| Disallow | /aviso-legal |
| Disallow | /politica-de-privacidad |
| Disallow | /politica-de-cookies |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
msiecrawler
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
webcopier
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
webreaper
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
httrack
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
baiduspider
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
gurujibot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
hl_ftien_spider
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
libwww
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
sogou spider
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
yeti
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
yodaobot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://fajobe.com.co/sitemap_index.xml |
Comments