realtysouth.com
robots.txt

Robots Exclusion Standard data for realtysouth.com

Resource Scan

Scan Details

Site Domain realtysouth.com
Base Domain realtysouth.com
Scan Status Ok
Last Scan2024-09-15T14:25:53+00:00
Next Scan 2024-10-15T14:25:53+00:00

Last Scan

Scanned2024-09-15T14:25:53+00:00
URL https://realtysouth.com/robots.txt
Redirect https://www.realtysouth.com/robots.txt
Redirect Domain www.realtysouth.com
Redirect Base realtysouth.com
Domain IPs 199.34.233.41
Redirect IPs 199.34.233.41
Response IP 199.34.233.41
Found Yes
Hash a484221f514ff1959f8fab54c0082e69f4e4792b7f02022b5fdbfdcb254c0e45
SimHash be5b9369d971

Groups

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow

googlebot

Rule Path
Disallow /*.aspx$
Disallow /index.asp?*
Disallow /?p=findagent.asp*
Disallow /?p=findoffice.asp*
Disallow /modules/internet/*
Disallow /modules/officegroup/*
Disallow /ThirdParty/
Disallow /clientdashboard/*
Disallow /?p=buildsavedsearch.asp*
Disallow /widgets/*

*

Rule Path
Disallow /modules/internet/logging/logwebhit.js
Disallow /modules/internet/logging/LogWebHit.aspx
Disallow /modules/internet/logging/LogAdHit.aspx
Disallow /modules/internet/logging/LogSearch.aspx
Disallow /modules/internet/logging/LogSearchResultsHistory.aspx
Disallow /modules/internet/logging/inc_loghit.asp
Disallow /modules/global/LogWebHit.aspx
Disallow /*?s=
Disallow /*?w=
Disallow /*sortbyid%3D
Disallow /*searchID%3D
Disallow /*searchid%3D
Disallow /*results%3D
Disallow /*selected%3D
Disallow /*sub%3D
Disallow /*pso%3D
Disallow /*referrer%3D
Disallow /home-details/*
Disallow /Listings/*

*

Rule Path
Disallow /389ccec4-85c4-4aa2-86f3-916bc9e768ec/admin

Other Records

Field Value
sitemap https://www.realtysouth.com/sitemap.xml

Comments

  • Backlink Analysis
  • Yandex
  • Google AdBot
  • Plead with robots/scrapers to not cause page views that Agents would see in their analytics.
  • Per Corby, if any bot hits this URL they are abusing robots.txt and should be blacklisted