dulinuts.com
robots.txt

Robots Exclusion Standard data for dulinuts.com

Resource Scan

Scan Details

Site Domain dulinuts.com
Base Domain dulinuts.com
Scan Status Ok
Last Scan2024-05-21T17:02:51+00:00
Next Scan 2024-06-04T17:02:51+00:00

Last Scan

Scanned2024-05-21T17:02:51+00:00
URL https://dulinuts.com/robots.txt
Domain IPs 104.21.65.229, 172.67.193.232, 2606:4700:3034::6815:41e5, 2606:4700:3034::ac43:c1e8
Response IP 104.21.65.229
Found Yes
Hash e72664294dd20040dd3b9373bc7c6f0807756bf82f03efbb2556c511c19f133e
SimHash 6d511e94d2b5

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

adsbot-google-mobile-apps

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

mediapartners (googlebot)

Rule Path
Disallow

apis-google

Rule Path
Disallow

facebot

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

facebookexternalhit/1.1

Rule Path
Disallow

pinterest

Rule Path
Disallow

twitterbot

Rule Path
Disallow

instagram

Rule Path
Disallow

yahoo-slurp

Rule Path
Disallow

slurp

Rule Path
Disallow

bingbot

Rule Path
Disallow

bingpreview

Rule Path
Disallow

msnbot

Rule Path
Disallow

msnbot-media

Rule Path
Disallow

adidxbot

Rule Path
Disallow

*

Rule Path
Disallow /
Disallow /admin/
Disallow /assets/
Disallow /kit/
Disallow /themes/
Disallow /thumb/
Disallow /index.php

Other Records

Field Value
sitemap https://dulinuts.com/sitemap.xml