smartaffiliatehub.com
robots.txt

Robots Exclusion Standard data for smartaffiliatehub.com

Resource Scan

Scan Details

Site Domain smartaffiliatehub.com
Base Domain smartaffiliatehub.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-11T16:17:01+00:00
Next Scan 2024-06-25T16:17:01+00:00

Last Successful Scan

Scanned2024-05-27T14:51:37+00:00
URL https://smartaffiliatehub.com/robots.txt
Domain IPs 2a02:4780:38:21bc:16ce:d06e:5b24:e684, 84.32.84.198
Response IP 93.127.196.129
Found Yes
Hash fec54e386f5f473e35d20360e84d593b92316842573ea4ae4f09f90e8ec763fa
SimHash 4f20da427691

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /wp-includes/
Disallow /author/
Disallow /page/
Disallow /category/
Disallow /wp-images/
Disallow /images/
Disallow /backup/
Disallow /banners/
Disallow /archives/
Disallow /trackback/
Disallow /feed/
Disallow /tag/

googlebot-image

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Allow /

Other Records

Field Value
sitemap https://smartaffiliatehub.com/sitemap.xml
sitemap https://smartaffiliatehub.com/sitemap.rss