Log In Sign Up

attomdata.com
robots.txt

Robots Exclusion Standard data for attomdata.com

Resource Scan

Scan Details

Site Domain attomdata.com
Base Domain attomdata.com
Scan Status Ok
Last Scan2024-10-20T21:33:23+00:00
Next Scan 2024-11-19T21:33:23+00:00

Last Scan

Scanned2024-10-20T21:33:23+00:00
URL https://attomdata.com/robots.txt
Redirect https://www.attomdata.com/robots.txt
Redirect Domain www.attomdata.com
Redirect Base attomdata.com
Domain IPs 13.107.246.59
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 3b96980628f4ffa6dd1e64fab55f21b204bd34b43725b236bd8aab6daeb07aa7
SimHash 721d4e92a7b5

Groups

*

Rule Path
Disallow /demo/*
Disallow /wp-admin/
Disallow /demo/public/avm/
Disallow /ical/
Disallow /?s=
Disallow /search/
Disallow /data/property-valuation-data/avm/attom-avm-webinar/
Disallow /data/boundaries-data/parcel-boundaries/the-benefits-of-boundary-data-for-your-business-webinar/
Disallow /data/transactions-mortgage-data/ibuyers-trends/ibuyer-impact-webinar/
Disallow /data/transactions-mortgage-data/mortgage-loan-data/mortgage-rates-webinar/
Disallow /solutions/property-navigator/create-your-account
Disallow /solutions/property-navigator/checkout
Allow /wp-admin/admin-ajax.php

petalbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

facebookexternalhit

Rule Path
Disallow /property-reports/
Disallow /data/us-real-estate/

Other Records

Field Value
crawl-delay 2

meta-externalfetcher

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

applebot

Rule Path
Disallow /property-reports/
Disallow /data/us-real-estate/

Other Records

Field Value
crawl-delay 5

amazonbot

Rule Path
Disallow /property-reports/
Disallow /data/us-real-estate/

Other Records

Field Value
crawl-delay 5

oai-searchbot

Rule Path
Disallow /property-reports/
Disallow /data/us-real-estate/

Other Records

Field Value
crawl-delay 5

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

omgili

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.attomdata.com/sitemap_index.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-geo-streets-index.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-al.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ak.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-az.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ar.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ca.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-co.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ct.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-de.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-dc.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-fl.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ga.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-hi.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-id.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-il.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-in.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ia.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ks.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ky.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-la.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-me.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-md.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ma.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-mi.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-mn.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ms.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-mo.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-mt.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ne.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-nv.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-nh.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-nj.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-nm.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ny.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-nc.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-nd.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-oh.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ok.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-or.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-pa.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ri.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-sc.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-sd.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-tn.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-tx.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-ut.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-vt.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-va.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-wa.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-wv.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-wi.xml
sitemap https://www.attomdata.com/gdpai-sitemaps/sitemap-properties-index-wy.xml
Back to top

Comments

  • Disallow specific crawlers
  • Crawl Control
  • AI Search Crawlers
  • Disallow AI trainers
Back to top