seniorhomes.com
robots.txt

Robots Exclusion Standard data for seniorhomes.com

Resource Scan

Scan Details

Site Domain seniorhomes.com
Base Domain seniorhomes.com
Scan Status Ok
Last Scan2024-10-27T01:29:11+00:00
Next Scan 2024-11-26T01:29:11+00:00

Last Scan

Scanned2024-10-27T01:29:11+00:00
URL https://www.seniorhomes.com/robots.txt
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132, 2a04:4e42:200::644, 2a04:4e42:400::644, 2a04:4e42:600::644, 2a04:4e42::644
Response IP 199.232.46.132
Found Yes
Hash 65f8bb11fb97e4ea55058e0fe05042c2a71c1ba2dccc22bfaf565b740952e751
SimHash dc996b7dc195

Groups

*

Rule Path
Disallow /digital/
Disallow /account/
Disallow /api/
Disallow /inspection/
Disallow /lp/
Disallow /util/
Disallow /s2/
Disallow /editlisting/
Disallow /tracking/
Disallow /c/*/veterans-benefits/$
Disallow /c/*/senior-moving/$
Disallow /c/*/care-advisor/$
Disallow /c/*/senior-living-center/$
Disallow /s/*/senior-living-center/$
Disallow /f/*/reviews/*
Disallow /a/*
Disallow /thankyou/
Disallow /search*
Disallow /maps/listings/
Disallow /maps/metros/
Disallow /reviews/post/
Disallow /*reviews/new
Disallow /f/*
Disallow /c/*
Disallow /s/*
Disallow /w/*
Disallow /z/*
Disallow /wordpress/*
Disallow /assets/*
Disallow /media/*
Disallow /css*
Disallow /seniorhomes.com/*

adsbot-google

Rule Path
Allow /digital/

adidxbot

Rule Path
Allow /digital/

Comments

  • pre-rails location for css files but lots of bot requests still
  • AdsBot
  • Bing/MS Ads bot