Log In Sign Up

numberoneproperty.com
robots.txt

Robots Exclusion Standard data for numberoneproperty.com

Resource Scan

Scan Details

Site Domain numberoneproperty.com
Base Domain numberoneproperty.com
Scan Status Ok
Last Scan2024-09-04T03:57:22+00:00
Next Scan 2024-10-04T03:57:22+00:00

Last Scan

Scanned2024-09-04T03:57:22+00:00
URL https://numberoneproperty.com/robots.txt
Domain IPs 104.21.32.227, 172.67.156.81, 2606:4700:3030::ac43:9c51, 2606:4700:3035::6815:20e3
Response IP 172.67.156.81
Found Yes
Hash d3f0d7ee5db44c3b66dc3aac6d03aee20af4b78b62c315e9246362f103b25a12
SimHash dd7f792ac5a1

Groups

*

Rule Path
Disallow /_?
Disallow /_%3D
Disallow /catalog/
Disallow /catalogsearch/
Disallow /cart/
Disallow /catalogsearch/result/
Disallow /catalogsearch/result/_?
Disallow /catalogsearch/result/_%3D
Disallow /checkout/
Disallow /checkout/_?
Disallow /checkout/_%3D
Disallow /admin/
Disallow /private/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /temp/
Disallow /logs/
Disallow /backup/
Disallow /cache/
Disallow /error/
Disallow /fonts/
Disallow /images/
Disallow /scripts/
Disallow /styles/
Disallow /uploads/
Disallow /search/
Disallow /404-thankyou/
Disallow /contact-us/thankyou/
Disallow /subscribe/thankyou/
Disallow /unsubscribe/thankyou/
Disallow /checkout/thankyou/
Disallow /thankyou/
Allow /

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler
baiduspider
easouspider
exabot
trovitbot
baiduspider+
yandexbot
mj12bot
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja
webreaper
zumbot

Rule Path
Disallow /
Back to top

Comments

  • Misc. Bot Rules
  • -----------------
Back to top

Warnings

  • 1 invalid line.
Back to top