solott.com
robots.txt

Robots Exclusion Standard data for solott.com

Resource Scan

Scan Details

Site Domain solott.com
Base Domain solott.com
Scan Status Ok
Last Scan2024-09-20T18:22:56+00:00
Next Scan 2024-09-27T18:22:56+00:00

Last Scan

Scanned2024-09-20T18:22:56+00:00
URL https://solott.com/robots.txt
Domain IPs 104.21.30.127, 172.67.172.236, 2606:4700:3033::6815:1e7f, 2606:4700:3035::ac43:acec
Response IP 172.67.172.236
Found Yes
Hash 81b3dfee8b1b1bfd6ab02dcbc7f09336832a0d5b5e1527570bed41885fab56a3
SimHash 2e5ac8ea46b9

Groups

*

Rule Path
Disallow /account/
Disallow /admin.php
Disallow /ajax/
Disallow /conversations/
Disallow /events/birthdays/
Disallow /events/monthly
Disallow /events/weekly
Disallow /find-new/
Disallow /goto/
Disallow /help/
Disallow /login/
Disallow /lost-password/
Disallow /media/categories
Disallow /media/playlists
Disallow /media/random
Disallow /media/submit
Disallow /media/services
Disallow /media/users
Disallow /media/category/
Disallow /media/keyword/
Disallow /media/user/
Disallow /media/service/
Disallow /media/submit/
Disallow /misc/style?*
Disallow /misc/quick-navigation-menu?*
Disallow /online/
Disallow /pages/conduct/
Disallow /pages/privacy/
Disallow /recent-activity/
Disallow /search/
Disallow /search/?type=post
Disallow /useralbums/
Disallow /useralbums/own
Disallow /useralbums/create
Disallow /watched/
Disallow /watched/threads

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

libwww

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /