netsmartz.com
robots.txt

Robots Exclusion Standard data for netsmartz.com

Resource Scan

Scan Details

Site Domain netsmartz.com
Base Domain netsmartz.com
Scan Status Ok
Last Scan2025-08-17T05:55:36+00:00
Next Scan 2025-09-16T05:55:36+00:00

Last Scan

Scanned2025-08-17T05:55:36+00:00
URL https://netsmartz.com/robots.txt
Domain IPs 104.21.34.56, 172.67.155.30, 2606:4700:3031::ac43:9b1e, 2606:4700:3033::6815:2238
Response IP 172.67.155.30
Found Yes
Hash fd756c090271678df0b912acae83d4c59da136e448e1b9fc856a0aa565749dcd
SimHash 492551504e17

Groups

twitterbot

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/themes/
Disallow /wp-includes/

*

Rule Path
Allow /wp-content/uploads/
Disallow /*feed
Disallow /pdf/
Disallow /whitepaper-pdf/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /signature_module/
Disallow /wp-content/themes/netsmartz/fetch_blogs.php
Disallow /wp-content/themes/netsmartz/fetch_openings.php
Disallow /*?wordfence_logHuman*
Disallow /*?wordfence_lh*

Other Records

Field Value
sitemap https://netsmartz.com/sitemap.xml

Comments

  • Block query strings (security)
  • Sitemap