sigmainfo.net
robots.txt

Robots Exclusion Standard data for sigmainfo.net

Resource Scan

Scan Details

Site Domain sigmainfo.net
Base Domain sigmainfo.net
Scan Status Ok
Last Scan2025-09-16T22:46:40+00:00
Next Scan 2025-10-16T22:46:40+00:00

Last Scan

Scanned2025-09-16T22:46:40+00:00
URL https://www.sigmainfo.net/robots.txt
Domain IPs 104.26.6.120, 104.26.7.120, 172.67.73.191, 2606:4700:20::681a:678, 2606:4700:20::681a:778, 2606:4700:20::ac43:49bf
Response IP 172.67.73.191
Found Yes
Hash ff3d3c01cfbf870e57bee81ace74d34c1c6bdf25e9ca368c7b1c32f9b5a28e31
SimHash 59b0cb924c91

Groups

oai-searchbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

youbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

googlebot

Rule Path
Allow /

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Disallow /author/
Disallow /in/author/
Disallow /blog/author/
Disallow /profile/
Disallow /my-profile/
Disallow /*?s=
Disallow /page/*?s=

Other Records

Field Value
sitemap https://www.sigmainfo.net/sitemap_index.xml

Comments

  • Allow major AI bots
  • Googlebot full access
  • All other bots
  • Sitemap