scanningtech.com
robots.txt

Robots Exclusion Standard data for scanningtech.com

Resource Scan

Scan Details

Site Domain scanningtech.com
Base Domain scanningtech.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-30T18:16:00+00:00
Next Scan 2025-11-29T18:16:00+00:00

Last Successful Scan

Scanned2025-09-08T10:21:09+00:00
URL https://scanningtech.com/robots.txt
Domain IPs 216.251.32.98
Response IP 216.251.32.98
Found Yes
Hash fde8f60e6b7cbad772063d035784a04b0ab225b2a19884595a13e6b992f97192
SimHash 64689a4c5dd5

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /author/
Disallow /category/
Disallow /portfolio-items/
Disallow /faq-items/

googlebot

Rule Path
Allow *.css
Allow *.js

Other Records

Field Value
sitemap https://scanningtech.com/sitemap_index.xml

Comments

  • robots txt generated by BlueHat
  • Googlebot
  • Sitemap