thevisualized.com
robots.txt

Robots Exclusion Standard data for thevisualized.com

Resource Scan

Scan Details

Site Domain thevisualized.com
Base Domain thevisualized.com
Scan Status Ok
Last Scan2024-09-25T14:44:43+00:00
Next Scan 2024-10-02T14:44:43+00:00

Last Scan

Scanned2024-09-25T14:44:43+00:00
URL https://thevisualized.com/robots.txt
Domain IPs 143.198.79.185
Response IP 143.198.79.185
Found Yes
Hash 909d6500c0d8b83e72666b6aa57b4b5123c9480bfa79a7152520accfaaf878fc
SimHash 6e555041c5d3

Groups

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

slurp

Rule Path
Disallow

msnbot

Rule Path
Disallow

bingbot

Rule Path
Disallow

twitterbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

facebot

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

yandex

Rule Path
Disallow

yandexcalendar

Rule Path
Disallow

yandexmobilebot

Rule Path
Disallow

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://thevisualized.com/sitemap.xml