smartchatbot.io
robots.txt

Robots Exclusion Standard data for smartchatbot.io

Resource Scan

Scan Details

Site Domain smartchatbot.io
Base Domain smartchatbot.io
Scan Status Ok
Last Scan2025-10-15T10:34:05+00:00
Next Scan 2025-11-14T10:34:05+00:00

Last Scan

Scanned2025-10-15T10:34:05+00:00
URL https://smartchatbot.io/robots.txt
Domain IPs 65.9.112.114, 65.9.112.13, 65.9.112.37, 65.9.112.58
Response IP 65.9.112.13
Found Yes
Hash 207205341f070098f7cee80633b7ce191ae04607921b24c314c3283fd6bdd8a1
SimHash 894c9cb86520

Groups

*

Rule Path
Allow /auth/login
Allow /auth/sign-up
Allow /auth/forgot-password
Allow /web-main$
Allow /image-generation
Allow /
Allow /horoscope$
Allow /horoscope/daily-horoscope$
Allow /horoscope/tarot-reading$
Allow /horoscope/coffee-reading$
Allow /horoscope/birth-chart-interpretation$
Allow /horoscope/love-compatibility$
Allow /horoscope/moon-tracking$
Allow /horoscope/retro-tracking$
Allow /horoscope/ritual-and-meditation$
Allow /horoscope/career-and-financial$
Allow /privacy-policy
Allow /terms-and-conditions
Allow /refund-policy
Disallow /web-main/*
Disallow /horoscope/daily-horoscope/*
Disallow /horoscope/tarot-reading/*
Disallow /horoscope/coffee-reading/*
Disallow /horoscope/birth-chart-interpretation/*
Disallow /horoscope/love-compatibility/*
Disallow /horoscope/moon-tracking/*
Disallow /horoscope/retro-tracking/*
Disallow /horoscope/ritual-and-meditation/*
Disallow /horoscope/career-and-financial/*
Disallow /photo-translate
Disallow /logo-maker
Disallow /tattoo-generator
Disallow /gallery
Disallow /settings
Disallow /settings/account
Disallow /settings/login-connection
Disallow /settings/my-plan

Other Records

Field Value
sitemap https://smartchatbot.io/sitemap.xml