mobi.lexa.nl
robots.txt

Robots Exclusion Standard data for mobi.lexa.nl

Resource Scan

Scan Details

Site Domain mobi.lexa.nl
Base Domain lexa.nl
Scan Status Ok
Last Scan2026-03-31T11:23:38+00:00
Next Scan 2026-04-07T11:23:38+00:00

Last Scan

Scanned2026-03-31T11:23:38+00:00
URL https://mobi.lexa.nl/robots.txt
Domain IPs 104.18.28.42, 104.18.29.42
Response IP 104.18.29.42
Found Yes
Hash e72196167ebb86d56697fd37c7d678c1874045c0535a5901146f9116138997e9
SimHash 4756fe110513

Groups

*

Rule Path
Disallow /redalert
Disallow /bin
Disallow /html
Disallow /keynote
Disallow /api/
Disallow /subscribe
Disallow /help/contactus.aspx
Disallow /accountsettings
Disallow /dailymatches
Disallow /events
Disallow /home
Disallow /interests
Disallow /matchbook
Disallow /matches
Disallow /messages
Disallow /profile
Disallow /safetycenter/
Disallow /search
Disallow /user
Disallow */misc/
Disallow */wp-content/
Disallow /ajax
Disallow /authent
Disallow /fullsignup
Disallow /mailbox
Disallow /messenger
Disallow /myaccount
Disallow /signup
Disallow *?Profile=*
Disallow *?display_ccform=*
Disallow *?dtd_id=*
Disallow *?id_itw=*
Disallow *?pg=*
Disallow *?query=*
Disallow *?ref=*
Disallow *?v=*
Disallow /apida/
Disallow /apimm/
Disallow /d/
Disallow /m/

adidxbot
baiduspider
facebot
httrack
mediapartners-google
nerdybot
omniexplorer_bot
scoutjet
searchmetricsbot
turnitinbot
wget
yandex

Rule Path
Disallow /

Comments

  • E2P Rules
  • New E2P Rules
  • Legacy Rules