josm9.sg-host.com
robots.txt
Robots Exclusion Standard data for josm9.sg-host.com
Resource Scan
Scan Details
| Site Domain | josm9.sg-host.com |
| Base Domain | sg-host.com |
| Scan Status | Ok |
| Last Scan | 2024-05-21T19:45:02+00:00 |
| Next Scan | 2024-06-20T19:45:02+00:00 |
Last Scan
| Scanned | 2024-05-21T19:45:02+00:00 |
| URL | http://josm9.sg-host.com/robots.txt |
| Domain IPs | 35.214.186.170 |
| Response IP | 35.214.186.170 |
| Found | Yes |
| Hash | 4b50c804cc265f8efe5d0af073d3283d0bf34c43317408010d181077813d1a53 |
| SimHash | 6a544252c832 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-content/*/*.jpg |
| Allow | /wp-content/*/*.png |
| Allow | /wp-content/*/*.gif |
| Allow | /wp-content/plugins/*.css |
| Allow | /wp-content/plugins/*.js |
| Allow | /wp-content/themes/*.css |
| Allow | /wp-content/themes/*.ttf |
| Allow | /wp-content/themes/*.wof |
| Allow | /wp-content/themes/*.js |
| Allow | /wp-content/uploads/ |
| Allow | /wp-includes/*/*.png |
| Allow | /wp-includes/*/*.js |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /*.css$ |
| Allow | /*.js$ |
| Disallow | /wp-admin/ |
| Disallow | /feed/ |
| Disallow | /max_conn |
| Disallow | /cf-api |
| Disallow | /cgi-bin/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-content/themes/ |
| Disallow | /cf-api |
| Disallow | /cgi-bin/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-content/themes/ |
| Disallow | /wp-content/upgrade/ |
| Disallow | /*/trackback/$ |
| Disallow | /*/page/*/ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
| Disallow | /*/*/*/trackback/$ |
| Disallow | /wp-includes/ |
| Disallow | /xmlrpc.php |
| Disallow | /*/feed/ |
| Disallow | /*/trackback/ |
| Disallow | /*/attachment/ |
| Disallow | /?attachment_id |
| Disallow | /author/ |
| Disallow | /comments/ |
| Disallow | /category/*/feed/ |
| Disallow | /anagrama/ |
| Disallow | /contacto/attachment/* |
| Disallow | /*? |
*
| Rule | Path |
|---|---|
| Disallow | /?s= |
| Disallow | /search |
compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
shopwiki
showyoubot
sosospider
wocbot
yeti
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://investe.es/sitemap_index.xml |
Comments