expertowps.com
robots.txt

Robots Exclusion Standard data for expertowps.com

Resource Scan

Scan Details

Site Domain expertowps.com
Base Domain expertowps.com
Scan Status Ok
Last Scan2026-01-14T03:48:37+00:00
Next Scan 2026-01-21T03:48:37+00:00

Last Scan

Scanned2026-01-14T03:48:37+00:00
URL https://expertowps.com/robots.txt
Domain IPs 104.21.90.218, 172.67.205.139, 2606:4700:3030::6815:5ada, 2606:4700:3033::ac43:cd8b
Response IP 172.67.205.139
Found Yes
Hash fdf3763797fd6ab499a2f456868fd15f1ca2dbece5018d254ff0ba827333bf2c
SimHash 4342d9502a13

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /*/*.css?v=*
Allow /*/*.js?ver=*
Disallow /page/*/?s=
Disallow /wp-json/
Disallow /?rest_route=
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /aviso-legal/
Disallow /politicas-de-cookies/
Disallow /politicas-de-privacidad/
Disallow /divulgacion-ftc/

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

ias-va

Rule Path
Disallow /

ias-ie

Rule Path
Disallow /

ias-or

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

ctã¢â‚¬â€˜gitã¢â‚¬â€˜scanner

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

internetmeasurement

Rule Path
Disallow /

thinkchaos

Rule Path
Disallow /

insites-scanner

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

restsharp

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

iframely

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

applebot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

domainchecker

Rule Path
Disallow /

thetradedesk

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://expertowps.com/sitemap_index.xml

Comments

  • Created by Walter Rodriguez - WordPress Expert (https://expertowps.com/)
  • Rules for good bots
  • ---------------------------
  • ---------------------------
  • Rules for good bots
  • Block bad bots
  • ---------------------------
  • Block bad bots
  • ---------------------------
  • ---------------------------
  • Created by Walter Rodriguez - WordPress Expert (https://expertowps.com/)