serverion.com
robots.txt

Robots Exclusion Standard data for serverion.com

Resource Scan

Scan Details

Site Domain serverion.com
Base Domain serverion.com
Scan Status Ok
Last Scan2024-11-01T17:51:24+00:00
Next Scan 2024-12-01T17:51:24+00:00

Last Scan

Scanned2024-11-01T17:51:24+00:00
URL https://serverion.com/robots.txt
Domain IPs 185.28.39.10, 2a01:7c8:bb0c:db:5054:ff:fe18:58e5
Response IP 185.28.39.10
Found Yes
Hash 28ba6fd9176ddccbc145f85b35fde4c3dbcbd8650bd5dc1d3455765af57f659b
SimHash 6a02d9510233

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Allow /wp-admin/admin-ajax.php

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.serverion.com/sitemap.xml

Comments

  • Disallow: /*?*
  • Disallow: /*?
  • Disallow: /*~*
  • Disallow: /*~