cuan123daftar.com
robots.txt

Robots Exclusion Standard data for cuan123daftar.com

Resource Scan

Scan Details

Site Domain cuan123daftar.com
Base Domain cuan123daftar.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-07-02T02:14:47+00:00
Next Scan 2024-09-30T02:14:47+00:00

Last Successful Scan

Scanned2023-11-13T02:13:27+00:00
URL https://cuan123daftar.com/robots.txt
Redirect https://cuan123zeus.com/robots.txt
Redirect Domain cuan123zeus.com
Redirect Base cuan123zeus.com
Domain IPs 162.0.214.42
Redirect IPs 162.0.214.42
Response IP 162.0.214.42
Found Yes
Hash 638ae04bf518bb8083215e1e2d35a71363d8751a1a395becb26856dfefdf6686
SimHash 2050d2825695

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/

ninjabot

Rule Path
Disallow /

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

teoma

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

yahoo-blogs

Rule Path
Allow /

yandex

Rule Path
Disallow /

specify

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cuan123zeus.com/sitemap.xml