wtffix.com
robots.txt

Robots Exclusion Standard data for wtffix.com

Resource Scan

Scan Details

Site Domain wtffix.com
Base Domain wtffix.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-10T14:36:13+00:00
Next Scan 2025-09-08T14:36:13+00:00

Last Successful Scan

Scanned2024-11-13T14:34:09+00:00
URL https://wtffix.com/robots.txt
Domain IPs 104.21.80.163, 172.67.151.143, 2606:4700:3031::ac43:978f, 2606:4700:3033::6815:50a3
Response IP 172.67.151.143
Found Yes
Hash 9230a3071fd89842915d01ff468b1c2faecf315b3aad90fb6a8097f1d660ae80
SimHash 4349d2420767

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-content/plugins/
Allow /wp-admin/admin-ajax.php

yandex

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /tag
Disallow /wp-json/*

mj12bot ahrefsbot baiduspider nutch ia_archiver webcopier webstripper teleport offline explorer sitesnagger psbot teleportpro emailsiphon emailcollector larbin blexbot semrushbot msiecrawler moget

Rule Path
Disallow /

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

Other Records

Field Value
sitemap https://wtffix.com/sitemap.xml

Comments

  • WP Import Export Rule

Warnings

  • `host` is not a known field.