the-tester.com
robots.txt

Robots Exclusion Standard data for the-tester.com

Resource Scan

Scan Details

Site Domain the-tester.com
Base Domain the-tester.com
Scan Status Ok
Last Scan2025-05-15T00:10:14+00:00
Next Scan 2025-05-29T00:10:14+00:00

Last Scan

Scanned2025-05-15T00:10:14+00:00
URL https://the-tester.com/robots.txt
Domain IPs 31.24.250.31
Response IP 31.24.250.31
Found Yes
Hash 6ff6bbeeb1e5702a4306afd56ca352eda6f44a061638351e23ffe15307780b1f
SimHash fd00c640d983

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /carts
Disallow /account
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls*ls*
Disallow /*/*?*ls*ls*
Disallow /search
Disallow /*?*product_count=
Disallow /*?*product_order=
Disallow /*?*product_view=
Disallow /*?*
Disallow /*?v=*

Other Records

Field Value
sitemap https://the-tester.com/sitemap_index.xml