se-keys.com
robots.txt

Robots Exclusion Standard data for se-keys.com

Resource Scan

Scan Details

Site Domain se-keys.com
Base Domain se-keys.com
Scan Status Ok
Last Scan2025-04-02T14:33:53+00:00
Next Scan 2025-05-02T14:33:53+00:00

Last Scan

Scanned2025-04-02T14:33:53+00:00
URL https://se-keys.com/robots.txt
Domain IPs 209.124.66.14
Response IP 209.124.66.14
Found Yes
Hash 94ce5cb3246e7e09cc68dd0520e186f131d8ac44d55af53766f90b328b17f711
SimHash fb0a8c1006a5

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /product-tag
Disallow /?add-to-cart*
Disallow /staging
Disallow /staging/
Disallow /*?lang=
Disallow /courses/
Disallow /*?master-access
Disallow /*?add-to-cart=
Disallow /*?attribute_

seek

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

velen

Rule Path
Disallow /

phantomjs

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mail.ru bot

Rule Path
Disallow /

slackbot-linkexpanding

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

survey

Rule Path
Disallow /

bit.ly

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://se-keys.com/new_sitemap.xml

Comments

  • Robots.txt generated by Booter - Crwalers Manager at Wed, 11 Jan 2023 23:42:07 +0000
  • Do not modify this file, any contents will be overwritten

Warnings

  • 2 invalid lines.