douglas.es
robots.txt

Robots Exclusion Standard data for douglas.es

Resource Scan

Scan Details

Site Domain douglas.es
Base Domain douglas.es
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-23T14:04:53+00:00
Next Scan 2024-12-22T14:04:53+00:00

Last Successful Scan

Scanned2024-05-20T14:02:49+00:00
URL https://douglas.es/robots.txt
Redirect https://www.douglas.es/robots.txt
Redirect Domain www.douglas.es
Redirect Base douglas.es
Domain IPs 23.215.7.19, 23.215.7.21, 2600:1413:b000:1b::17d7:713, 2600:1413:b000:1b::17d7:715
Redirect IPs 23.61.205.42, 23.61.205.80, 2600:1413:b000:1b::17d7:713, 2600:1413:b000:1b::17d7:715
Response IP 23.52.40.10
Found Yes
Hash f05b57825404e2a20ee050ec2b12aee810757828e9b6e1b818b36d2f17ab144a
SimHash 4f548b14da81

Groups

*

Rule Path
Disallow /account
Disallow /cart
Disallow /checkout
Disallow /error
Disallow /datafeed/*
Disallow /wishlist
Disallow /search.html*
Disallow /search*
Disallow /*?q=*
Disallow /*?bvstate=*
Disallow /*?sourceRef=*
Disallow /*?nomobile=true*
Disallow /*?sortAsc=*
Disallow /*?rdeTemplate=*
Disallow /*?sortField=*
Disallow /es/b/*/b*_28
Disallow /es/b/*/b*_84
Disallow /es/b/*/b*_8411
Disallow /es/b/*/b*_27
Disallow /es/b/*/b*_2705
Disallow /es/b/*/b*_2701
Disallow /es/b/*/b*_86
Disallow /es/b/*/b*_8604
Disallow /es/b/*/b*_44
Disallow /es/b/*/b*_4401
Disallow /es/b/*/b*_440104
Disallow /es/b/*/b*_4402
Disallow /es/b/*/b*_440204
Disallow /es/b/*/b*_56
Disallow /es/b/*/b*_83
Disallow /es/b/*/b*_24
Disallow /es/b/*/b*_2401
Disallow /es/b/*/b*_2413
Disallow /es/b/*/b*_240101
Disallow /es/b/*/b*_240102
Disallow /es/b/*/b*_240105
Disallow /es/b/*/b*_2403
Disallow /es/b/*/b*_240304
Disallow /es/b/*/b*_2402
Disallow /es/b/*/b*_240205
Disallow /es/b/*/b*_2412
Disallow /es/b/*/b*_65
Disallow /es/b/*/b*_82
Disallow /es/b/*/b*_8204
Disallow /es/b/*/b*_94
Disallow /es/b/*/b*_35
Disallow /es/b/*/b*_6501
Disallow /es/b/*/b*_6502

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adidxbot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.douglas.es/api/v2/es_ES_dgl/sitemap/sitemap.xml
sitemap https://www.douglas.es/api/v2/es_ES_dgl/sitemap/productsitemap0.xml
sitemap https://www.douglas.es/api/v2/es_ES_dgl/sitemap/categorysitemap0.xml
sitemap https://www.douglas.es/api/v2/es_ES_dgl/sitemap/brandsitemap0.xml
sitemap https://www.douglas.es/api/v2/es_ES_dgl/sitemap/imagesitemap0.xml
sitemap https://www.douglas.es/api/v2/es_ES_dgl/sitemap/imagesitemap1.xml
sitemap https://www.douglas.es/api/v2/es_ES_dgl/sitemap/imagesitemap2.xml
sitemap https://www.douglas.es/api/v2/es_ES_dgl/sitemap/imagesitemap3.xml
sitemap https://www.douglas.es/api/v2/es_ES_dgl/sitemap/Contentsitemap0.xml
sitemap https://www.douglas.es/api/v2/es_ES_dgl/sitemap/storesitemap0.xml