duwitmu.com
robots.txt

Robots Exclusion Standard data for duwitmu.com

Resource Scan

Scan Details

Site Domain duwitmu.com
Base Domain duwitmu.com
Scan Status Ok
Last Scan2024-11-09T00:26:13+00:00
Next Scan 2024-11-16T00:26:13+00:00

Last Scan

Scanned2024-11-09T00:26:13+00:00
URL https://duwitmu.com/robots.txt
Domain IPs 104.26.4.166, 104.26.5.166, 172.67.70.199, 2606:4700:20::681a:4a6, 2606:4700:20::681a:5a6, 2606:4700:20::ac43:46c7
Response IP 104.26.4.166
Found Yes
Hash dd2f315b6e25669cbfdb346ed849e6e0ad9b215ea32c5d29c382d6d36677f8ec
SimHash 6043d2e7763d

Groups

*

Rule Path
Allow /.well-known/amphtml/apikey.pub
Disallow /backoffice
Disallow /node_modules
Disallow /backoffice/*
Disallow /api/*
Disallow /*?s=*
Disallow /*?wordfence_lh=*
Disallow /wp_*
Disallow /test
Disallow /*?w=*

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

applebot

Rule Path
Allow /

yandex

Rule Path
Allow /

yandeximages

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

qwantify

Rule Path
Allow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://duwitmu.com/sitemap.xml