janedeboy.com
robots.txt

Robots Exclusion Standard data for janedeboy.com

Resource Scan

Scan Details

Site Domain janedeboy.com
Base Domain janedeboy.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-19T17:57:12+00:00
Next Scan 2024-10-03T17:57:12+00:00

Last Successful Scan

Scanned2024-08-12T04:57:58+00:00
URL https://janedeboy.com/robots.txt
Redirect https://www.janedeboy.com/robots.txt
Redirect Domain www.janedeboy.com
Redirect Base janedeboy.com
Domain IPs 91.216.228.156
Redirect IPs 91.216.228.156
Response IP 91.216.228.156
Found Yes
Hash 3fd9385eba6f8be7bc45fbdf6b5660a927a354212f8863cf385b79dcef037df8
SimHash 3cd353ca8ec7

Groups

*

Rule Path
Disallow /*?r=
Disallow /*?a=
Disallow /*?id*
Disallow /*.axd
Disallow /*%2C*
Disallow /ws/
Disallow /Interface/
Disallow /wsA*.aspx
Disallow /wsS*.aspx
Disallow /wsC*.aspx
Disallow /connexion.aspx
Disallow /maWishlist.aspx
Disallow /panier.aspx
Disallow /monCompte.aspx
Disallow /conditions-promo.aspx
Disallow /lBox/

adequat

Rule Path
Disallow /

admantx bot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

corporama

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotmic dotbot

Rule Path
Disallow /

ellisphere

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

fetch

Rule Path
Disallow /

grapeshot bot

Rule Path
Disallow /

houzzbot

Rule Path
Disallow /

infoseek

Rule Path
Disallow /

jetbot

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

leadbox

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

linko

Rule Path
Disallow /

mail.ru bot

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

opinion-tracker

Rule Path
Disallow /

proxem

Rule Path
Disallow /

proximic bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

spotter

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

verticalsearch

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

winello

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.janedeboy.com/sitemap-index.xml