stanfy.com
robots.txt

Robots Exclusion Standard data for stanfy.com

Resource Scan

Scan Details

Site Domain stanfy.com
Base Domain stanfy.com
Scan Status Ok
Last Scan2025-10-10T10:57:40+00:00
Next Scan 2025-11-09T10:57:40+00:00

Last Scan

Scanned2025-10-10T10:57:40+00:00
URL https://stanfy.com/robots.txt
Redirect https://www.intellectsoft.net/robots.txt
Redirect Domain www.intellectsoft.net
Redirect Base intellectsoft.net
Domain IPs 104.21.5.158, 172.67.133.154
Redirect IPs 104.21.5.158, 172.67.133.154
Response IP 104.21.5.158
Found Yes
Hash f41ff5c6f06e7da0de2d96889e268aef0a407a619e43f080f602782e77277967
SimHash 4560aa73cfb4

Groups

*

Rule Path
Disallow /category
Disallow /events
Disallow /news
Disallow /documents-old
Disallow /resources/
Disallow /blog/author
Disallow /*.pdf
Disallow /*.html
Disallow /?
Disallow /l/
Disallow */feed
Disallow /blog/cases/
Disallow /s/
Disallow /client-id
Disallow /go/
Disallow /goto/
Disallow /404
Disallow /403
Disallow /500

mediapartners-google

Rule Path
Allow /l/

adsbot-google

Rule Path
Allow /l/

adsbot-google-mobile

Rule Path
Allow /l/

adidxbot

Rule Path
Allow /l/

Other Records

Field Value
sitemap https://www.intellectsoft.net/sitemap.xml

Warnings

  • `host` is not a known field.