blog.unioneprofessionisti.com
robots.txt

Robots Exclusion Standard data for blog.unioneprofessionisti.com

Resource Scan

Scan Details

Site Domain blog.unioneprofessionisti.com
Base Domain unioneprofessionisti.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2025-09-17T00:45:23+00:00
Next Scan 2025-12-16T00:45:23+00:00

Last Successful Scan

Scanned2024-07-31T22:59:36+00:00
URL https://blog.unioneprofessionisti.com/robots.txt
Domain IPs 138.201.148.199
Response IP 138.201.148.199
Found Yes
Hash 2ce7c33ff33dba52175910176b882d666bbb063927227e6d2abe4644bfe0ea06
SimHash 8818ccd6e593

Groups

*

Rule Path
Disallow /.usermin/
Disallow /awstats-icon/
Disallow /awstatsicons/
Disallow /newsletter/
Disallow /banner/
Allow /pdf/*.pdf$
Allow /banner/*.jpg*
Allow /banner/*.gif*
Disallow /icon/
Disallow /include/
Disallow /stats/
Disallow /wp-
Disallow /wp-admin/
Allow /wp-admin/*admin-ajax.php*
Disallow /wp-includes/
Disallow /wp-content/
Allow /wp-content/uploads/
Disallow /*?*
Disallow /*?
Disallow /comment-
Disallow /*.pdf$
Allow /wp-includes/*.js*
Allow /wp-includes/*.css*
Allow /wp-content/*.css*
Allow /wp-content/*.jpg*
Allow /wp-content/*.png*
Allow /wp-content/*.js*
Allow /wp-content/*.gif*
Allow /wp-content/*.woff*
Allow /wp-content/*.ttf*
Allow /wp-content/*.svg*
Allow /include/*jquery.fancybox.css*
Allow /include/*jquery.fancybox.pack.js*
Allow /include/*.css*
Allow /include/*.js*

Other Records

Field Value
sitemap https://blog.unioneprofessionisti.com/sitemap_index.xml
sitemap https://blog.unioneprofessionisti.com/pdf/sitemap.php