smartwayconsultants.com
robots.txt

Robots Exclusion Standard data for smartwayconsultants.com

Resource Scan

Scan Details

Site Domain smartwayconsultants.com
Base Domain smartwayconsultants.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-09T00:32:11+00:00
Next Scan 2024-11-07T00:32:11+00:00

Last Successful Scan

Scanned2023-04-14T23:03:52+00:00
URL https://smartwayconsultants.com/robots.txt
Domain IPs 192.46.208.242
Response IP 192.46.208.242
Found Yes
Hash c0672503d0add20a8fd0df3e9121185c046c2d75bd0a45f9ccf4f0e3ee8ef409
SimHash 65289a64c8b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 15

ahrefsbot disallow:/
semrushbot disallow:/
rogerbot disallow: /
xenu disallow: /
mj12bot disallow: /

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://smartwayconsultants.com/sitemap_index.xml