Log In Sign Up

homefacts.com
robots.txt

Robots Exclusion Standard data for homefacts.com

Resource Scan

Scan Details

Site Domain homefacts.com
Base Domain homefacts.com
Scan Status Ok
Last Scan2024-10-22T04:17:29+00:00
Next Scan 2024-11-21T04:17:29+00:00

Last Scan

Scanned2024-10-22T04:17:29+00:00
URL https://homefacts.com/robots.txt
Redirect https://www.homefacts.com/robots.txt
Redirect Domain www.homefacts.com
Redirect Base homefacts.com
Domain IPs 13.107.246.59
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 293d6773eb11cb773e71429a60e3c374e39f671b240751078dd12faccf5340ec
SimHash 6a161151c4a1

Groups

googlebot

Rule Path
Disallow /images/offenders/rhodeisland/thumb/

googlebot-image

Rule Path
Disallow /images/offenders/rhodeisland/thumb/

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

meta-externalfetcher

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

oai-searchbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

applebot-extended

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

omgili

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

*

Rule Path
Disallow /zing/xml/
Disallow /ads.html?
Disallow /6584879/*
Disallow /svgmaps/*
Disallow /driving-directions.html?*
Disallow /flight-delay-details.html?*
Disallow /address-map.html?*
Disallow /ajaxcalls/*
Disallow /?q=*
Disallow /ads/mortgagetracking.html?*
Disallow /maps.html?id=*
Disallow /localwidget_v2*
Disallow /localwidget*
Disallow /widget/*
Disallow /myalerts/*
Disallow /myaddress/*
Disallow /unsubscribealerts/*
Disallow /resetpassword.html
Disallow /error.html
Disallow /addresssearch/ajax.html
Disallow /religions/churches/*
Disallow /hf_pro/*
Disallow /tabwidget.html*
Disallow /widgets.html*
Disallow /maps-state-airports.html*
Back to top

Other Records

Field Value
sitemap https://www.homefacts.com/sitemap2x/address/AK/sitemap-address-ak-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/AL/sitemap-address-al-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/AR/sitemap-address-ar-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/AZ/sitemap-address-az-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/CA/sitemap-address-ca-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/CA/sitemap-address-ca-2.xml
sitemap https://www.homefacts.com/sitemap2x/address/CO/sitemap-address-co-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/CT/sitemap-address-ct-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/DC/sitemap-address-dc-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/DE/sitemap-address-de-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/FL/sitemap-address-fl-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/GA/sitemap-address-ga-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/HI/sitemap-address-hi-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/IA/sitemap-address-ia-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/ID/sitemap-address-id-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/IL/sitemap-address-il-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/IN/sitemap-address-in-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/KS/sitemap-address-ks-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/KY/sitemap-address-ky-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/LA/sitemap-address-la-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/MA/sitemap-address-ma-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/MD/sitemap-address-md-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/ME/sitemap-address-me-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/MI/sitemap-address-mi-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/MN/sitemap-address-mn-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/MO/sitemap-address-mo-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/MS/sitemap-address-ms-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/MT/sitemap-address-mt-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/NC/sitemap-address-nc-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/ND/sitemap-address-nd-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/NE/sitemap-address-ne-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/NH/sitemap-address-nh-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/NJ/sitemap-address-nj-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/NM/sitemap-address-nm-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/NV/sitemap-address-nv-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/NY/sitemap-address-ny-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/OH/sitemap-address-oh-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/OK/sitemap-address-ok-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/OR/sitemap-address-or-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/PA/sitemap-address-pa-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/RI/sitemap-address-ri-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/SC/sitemap-address-sc-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/SD/sitemap-address-sd-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/TN/sitemap-address-tn-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/TX/sitemap-address-tx-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/UT/sitemap-address-ut-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/VA/sitemap-address-va-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/VT/sitemap-address-vt-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/WA/sitemap-address-wa-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/WI/sitemap-address-wi-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/WV/sitemap-address-wv-1.xml
sitemap https://www.homefacts.com/sitemap2x/address/WY/sitemap-address-wy-1.xml
sitemap https://www.homefacts.com/sitemap2x/offenders/offenders-1.xml
sitemap https://www.homefacts.com/sitemap2x/offender-detail/offender-detail-1.xml
sitemap https://www.homefacts.com/sitemap2x/city/city-1.xml
sitemap https://www.homefacts.com/sitemap2x/crime/crime-1.xml
sitemap https://www.homefacts.com/sitemap2x/earthquakes/earthquakes-1.xml
sitemap https://www.homefacts.com/sitemap2x/environmentalhazards/environmentalhazards-1.xml
sitemap https://www.homefacts.com/sitemap2x/hurricanes/hurricanes-1.xml
sitemap https://www.homefacts.com/sitemap2x/methlabs/methlabs-1.xml
sitemap https://www.homefacts.com/sitemap2x/properties/properties-1.xml
sitemap https://www.homefacts.com/sitemap2x/schools/schools-1.xml
sitemap https://www.homefacts.com/sitemap2x/tornadoes/tornadoes-1.xml
sitemap https://www.homefacts.com/sitemap2x/zip-code/zip-code-1.xml
Back to top

Comments

  • Disallow specific crawlers
  • SEO crawl control
  • AI search crawl control
  • Disallow AI trainers
Back to top