dengronnesti.com
robots.txt

Robots Exclusion Standard data for dengronnesti.com

Resource Scan

Scan Details

Site Domain dengronnesti.com
Base Domain dengronnesti.com
Scan Status Ok
Last Scan2024-09-25T08:14:53+00:00
Next Scan 2024-10-02T08:14:53+00:00

Last Scan

Scanned2024-09-25T08:14:53+00:00
URL https://dengronnesti.com/robots.txt
Domain IPs 104.21.27.161, 172.67.143.62, 2606:4700:3031::6815:1ba1, 2606:4700:3037::ac43:8f3e
Response IP 104.21.27.161
Found Yes
Hash 7f02ad49ee5b3ae39f568f846fea69f3c9f08cd5e091a30c27e2754691fc0ca8
SimHash 2d54a39254b5

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

msnbot

Rule Path
Disallow

bingbot

Rule Path
Disallow

bingpreview

Rule Path
Disallow

blekkobot

Rule Path
Disallow

scoutjet

Rule Path
Disallow

exabot

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

teoma

Rule Path
Disallow

baiduspider

Rule Path
Disallow

sogou

Rule Path
Disallow

psbot

Rule Path
Disallow

asterias

Rule Path
Disallow

yandex

Rule Path
Disallow

qwant

Rule Path
Disallow

naverbot

Rule Path
Disallow

seznambot

Rule Path
Disallow

pinterest

Rule Path
Disallow

clizq

Rule Path
Disallow

*

Rule Path
Disallow /

*

Rule Path
Disallow /ads/

googlebot

Rule Path
Allow /ads.txt

Other Records

Field Value
sitemap https://dengronnesti.com/sitemap_index.xml/