propnewstime.com
robots.txt

Robots Exclusion Standard data for propnewstime.com

Resource Scan

Scan Details

Site Domain propnewstime.com
Base Domain propnewstime.com
Scan Status Ok
Last Scan2025-12-30T10:52:58+00:00
Next Scan 2026-01-29T10:52:58+00:00

Last Scan

Scanned2025-12-30T10:52:58+00:00
URL https://propnewstime.com/robots.txt
Domain IPs 104.21.35.29, 172.67.212.74, 2606:4700:3031::ac43:d44a, 2606:4700:3033::6815:231d
Response IP 104.21.35.29
Found Yes
Hash 5c4f6226ffd538a0243d86482fc7f28c53b44bf80a5fc6b1fca3045126c1872b
SimHash 20145402c783

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /pnt/landing_page

msnbot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

psbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://propnewstime.com/sitemap.xml