baityourhook.com
robots.txt

Robots Exclusion Standard data for baityourhook.com

Resource Scan

Scan Details

Site Domain baityourhook.com
Base Domain baityourhook.com
Scan Status Ok
Last Scan2025-12-31T21:05:45+00:00
Next Scan 2026-01-14T21:05:45+00:00

Last Scan

Scanned2025-12-31T21:05:45+00:00
URL https://baityourhook.com/robots.txt
Domain IPs 20.49.104.3
Response IP 20.49.104.3
Found Yes
Hash 78e31ab0024c4e077feec7294137f754de9bc11c46a3291e5fdf096e676c0eeb
SimHash 6551bd5067da

Groups

adsbot-google-mobile

Rule Path
Disallow /*?*
Disallow /signup*
Disallow /signin
Disallow /confirm
Disallow /password-reset
Disallow /logout
Disallow /search
Disallow /booking
Disallow /unsubscribe
Disallow /error
Disallow /operator

adsbot-google

Rule Path
Disallow /*?*
Disallow /signup*
Disallow /signin
Disallow /confirm
Disallow /password-reset
Disallow /logout
Disallow /search
Disallow /booking
Disallow /unsubscribe
Disallow /error
Disallow /operator

googlebot

Rule Path
Disallow /*?*
Disallow /signup*
Disallow /signin
Disallow /confirm
Disallow /password-reset
Disallow /logout
Disallow /search
Disallow /booking
Disallow /unsubscribe
Disallow /error
Disallow /operator

bingbot

Rule Path
Disallow /*?*
Disallow /signup*
Disallow /signin
Disallow /confirm
Disallow /password-reset
Disallow /logout
Disallow /search
Disallow /booking
Disallow /unsubscribe
Disallow /error
Disallow /operator

yandexbot

Rule Path
Disallow /*?*
Disallow /signup*
Disallow /signin
Disallow /confirm
Disallow /password-reset
Disallow /logout
Disallow /search
Disallow /booking
Disallow /unsubscribe
Disallow /error
Disallow /operator

baiduspider

Rule Path
Disallow /*?*
Disallow /signup*
Disallow /signin
Disallow /confirm
Disallow /password-reset
Disallow /logout
Disallow /search
Disallow /booking
Disallow /unsubscribe
Disallow /error
Disallow /operator

*

Rule Path
Disallow /*?*
Disallow /signup*
Disallow /signin
Disallow /confirm
Disallow /password-reset
Disallow /logout
Disallow /search
Disallow /booking
Disallow /unsubscribe
Disallow /error
Disallow /operator

Other Records

Field Value
sitemap https://www.baityourhook.com/sitemap.xml

Warnings

  • `host` is not a known field.