lovesita.com
robots.txt

Robots Exclusion Standard data for lovesita.com

Resource Scan

Scan Details

Site Domain lovesita.com
Base Domain lovesita.com
Scan Status Ok
Last Scan2024-09-20T10:49:01+00:00
Next Scan 2024-10-20T10:49:01+00:00

Last Scan

Scanned2024-09-20T10:49:01+00:00
URL https://lovesita.com/robots.txt
Domain IPs 193.138.195.213
Response IP 193.138.195.213
Found Yes
Hash ed3a3180dbe5743e060b20fcfc4f0ed1a8f8ce7ac8906d350ca30102a733fcdd
SimHash 401c0aa07e21

Groups

*

Rule Path
Allow /escort-gay-hetero/$
Disallow /escort-gay-hetero/*
Allow /bdsm/$
Disallow /bdsm/*
Disallow /BDSM/*
Disallow /escort-girl-paris/Paris
Disallow /avis-legal
Disallow /aviso-legal
Disallow /dev/
Disallow /sandbox/
Disallow /announce-expired
Disallow /pricing/renew

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fyberspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

seranking_audit_bot

Rule Path
Disallow /

jamesbot

Rule Path
Disallow /

*

Rule Path
Disallow /devspc/*

*

Rule Path
Disallow /pricing/*

*

Rule Path
Disallow /webcam/*

Comments

  • Allow: /escort-trans-paris/$
  • Disallow: /toplist

Warnings

  • 2 invalid lines.