6sense.com
robots.txt
Robots Exclusion Standard data for 6sense.com
Resource Scan
Scan Details
| Site Domain | 6sense.com |
| Base Domain | 6sense.com |
| Scan Status | Ok |
| Last Scan | 2024-05-27T15:15:20+00:00 |
| Next Scan | 2024-06-10T15:15:20+00:00 |
Last Scan
| Scanned | 2024-05-27T15:15:20+00:00 |
| URL | https://6sense.com/robots.txt |
| Domain IPs | 141.193.213.20, 141.193.213.21 |
| Response IP | 141.193.213.20 |
| Found | Yes |
| Hash | b4c8f1e0f36b645a0f3793ce26fe9879542081d9382ff88c9e3f241fb889a3ec |
| SimHash | f50fc2d2abb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /tech/sales-intelligence/ |
| Disallow | /platform/sales/signup-verify/ |
| Allow | /wp-admin/admin-ajax.php |
yandex
dotbot
rogerbot
moget
ichiro
naverbot
yeti
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
mj12bot
djecobot
bubing
yahoo pipes 2.0
balihoo
botrighthere
webzip
url_spider_pro
cherrypicker
emailcollector
emailsiphon
webbandit
emailwolf
extractorpro
crescent
sitesnagger
prowebwalker
cheesebot
lnspiderguy
lexibot
teleport
teleportpro
miixpc
telesoft
website quester
moget/2.1
webstripper
websauger
webcopier
spanner
spankbot
bunnyslippers
asterias
backdoorbot/1.0
black hole
blowfish/1.0
copyrightcheck
dittospyder
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://6sense.com/sitemaps.xml |
Warnings
- 1 invalid line.