linkpro24.com
robots.txt

Robots Exclusion Standard data for linkpro24.com

Resource Scan

Scan Details

Site Domain linkpro24.com
Base Domain linkpro24.com
Scan Status Ok
Last Scan2024-09-21T16:29:32+00:00
Next Scan 2024-09-28T16:29:32+00:00

Last Scan

Scanned2024-09-21T16:29:32+00:00
URL https://www.linkpro24.com/robots.txt
Domain IPs 104.21.89.94, 172.67.139.184, 2606:4700:3031::ac43:8bb8, 2606:4700:3035::6815:595e
Response IP 172.67.139.184
Found Yes
Hash 383f9ce0140c141069242487cc22f87114dbc1fc7ca253bbb5ee18f9e4477e88
SimHash 08e1d8134db7

Groups

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 800

*

Rule Path
Disallow /*confirm.html*
Disallow /*listing-details.html*
Disallow /*print.html*
Disallow /404.html*
Disallow /*listing-remove.html*
Disallow /*browse-by-body-style.html*
Disallow /*articlesandupdates.html*
Disallow /*pdf-export.html*
Disallow /*newsletter.html*
Disallow /*print-loan-schedule.html*
Disallow /*excel-import-export.html*
Disallow /*booking-order.html*
Disallow /*comparision-tables.html*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.linkpro24.com/sitemap.xml

Comments

  • Rules generated by the Sitemap plugin
  • Excluded pages: