netsmartz.us
robots.txt

Robots Exclusion Standard data for netsmartz.us

Resource Scan

Scan Details

Site Domain netsmartz.us
Base Domain netsmartz.us
Scan Status Ok
Last Scan2025-09-06T23:45:04+00:00
Next Scan 2025-10-06T23:45:04+00:00

Last Scan

Scanned2025-09-06T23:45:04+00:00
URL http://netsmartz.us/robots.txt
Redirect https://netsmartz.com/robots.txt
Redirect Domain netsmartz.com
Redirect Base netsmartz.com
Domain IPs 64.98.135.93
Redirect IPs 104.21.34.56, 172.67.155.30, 2606:4700:3031::ac43:9b1e, 2606:4700:3033::6815:2238
Response IP 104.21.34.56
Found Yes
Hash fd756c090271678df0b912acae83d4c59da136e448e1b9fc856a0aa565749dcd
SimHash 492551504e17

Groups

twitterbot

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/themes/
Disallow /wp-includes/

*

Rule Path
Allow /wp-content/uploads/
Disallow /*feed
Disallow /pdf/
Disallow /whitepaper-pdf/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /signature_module/
Disallow /wp-content/themes/netsmartz/fetch_blogs.php
Disallow /wp-content/themes/netsmartz/fetch_openings.php
Disallow /*?wordfence_logHuman*
Disallow /*?wordfence_lh*

Other Records

Field Value
sitemap https://netsmartz.com/sitemap.xml

Comments

  • Block query strings (security)
  • Sitemap