dyjz00pttbyut.cloudfront.net
robots.txt

Robots Exclusion Standard data for dyjz00pttbyut.cloudfront.net

Resource Scan

Scan Details

Site Domain dyjz00pttbyut.cloudfront.net
Base Domain dyjz00pttbyut.cloudfront.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-20T20:12:23+00:00
Next Scan 2024-11-03T20:12:23+00:00

Last Successful Scan

Scanned2024-10-05T20:11:33+00:00
URL https://dyjz00pttbyut.cloudfront.net/robots.txt
Domain IPs 108.156.133.60, 108.156.133.95, 108.156.133.98, 108.156.133.99
Response IP 108.156.133.95
Found Yes
Hash b45349df93a7ac7dfc29ffe9bdea9a3dd855ea716dd99d7f9500cc738fe4ee5b
SimHash 74b8980904fc

Groups

*

Rule Path
Allow /
Allow /guide/nri
Disallow /filters*
Disallow */*/*house-sale*
Disallow */*crores
Disallow /google_page_*.php?*
Disallow /cities.php
Disallow /sitemap-details.php
Disallow /builders-in.php
Disallow /localities-in.php
Disallow /property.php
Disallow /projects.php
Disallow /builders.php
Disallow /maps/
Disallow /fetch/maps/
Disallow /test/
Disallow /newdirectory/property-in-india.php
Disallow /real-estate-india
Disallow /real-estate-india.php
Disallow /*/bhk
Disallow */*bhk/budget-
Disallow /*/overview$
Disallow /*sites-plots-sale*/*bhk
Disallow *utm_*
Disallow /news/
Disallow /gallerypopup.php*
Disallow /common_widgets.php?*
Disallow /my-account.php
Disallow /my-account-setting.php
Disallow /mobile/
Disallow /property/
Disallow /m/
Disallow /snapshots*
Disallow /p-*.php
Disallow /b-*.php
Disallow /property-in-*-real-estate.php
Disallow /plugins/feedback.php*
Disallow /*/faqs$
Disallow /*/privacy-policy$
Disallow /*/contactus$
Disallow /*/emi$
Disallow /*/nri$
Disallow /*/disclaimer$
Disallow /*/homeloan$
Disallow /*/user-agreement$
Disallow /*/aboutus$
Disallow /*/vaastu$
Disallow /*/propinsight$
Disallow /*/filters?*
Disallow /portfolio
Disallow /login
Disallow /myshortlist
Disallow /nearby/
Disallow /guide/search
Disallow /guide/author
Disallow /guide/?p=
Disallow /guide/admin
Disallow /all-builders?*
Disallow /thirdeye
Disallow /4d-view
Disallow /projects-in-*
Disallow /city/*
Disallow /locality/*
Disallow /builder/*
Disallow /project/*
Disallow /listing/*
Disallow /compare/*
Disallow /responsive/app-download
Disallow /user-dashboard*
Disallow /*/apidocs
Disallow /international/*

proximic
mj12bot
petalbot
dataforseobot
ahrefsbot

Rule Path
Disallow /

yandex
yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.proptiger.com/secure-sitemap-index.xml
sitemap https://www.proptiger.com/city-image-sitemap.xml
sitemap https://www.proptiger.com/secure-image-sitemap.xml
sitemap https://www.proptiger.com/secure-image-sitemap-1.xml
sitemap https://www.proptiger.com/secure-image-sitemap-2.xml
sitemap https://www.proptiger.com/secure-image-sitemap-3.xml
sitemap https://www.proptiger.com/secure-image-sitemap-4.xml
sitemap https://www.proptiger.com/video-sitemap.xml
sitemap https://www.proptiger.com/feed/rss-feed.xml

Comments

  • robots.txt for https://www.proptiger.com
  • Online Property Buying
  • New City Url
  • Blocking SEM Pages
  • RESPONSIVE APP DOWNLOAD
  • User Dashboard
  • api docs
  • INTERNATIONAL PAGES
  • Disallow specific user agent
  • Crawl delay Yandex user agent