goldsteinresearch.com
robots.txt

Robots Exclusion Standard data for goldsteinresearch.com

Resource Scan

Scan Details

Site Domain goldsteinresearch.com
Base Domain goldsteinresearch.com
Scan Status Ok
Last Scan2024-10-22T06:04:17+00:00
Next Scan 2024-11-21T06:04:17+00:00

Last Scan

Scanned2024-10-22T06:04:17+00:00
URL https://goldsteinresearch.com/robots.txt
Redirect https://www.goldsteinresearch.com/robots.txt
Redirect Domain www.goldsteinresearch.com
Redirect Base goldsteinresearch.com
Domain IPs 104.21.29.54, 172.67.171.96, 2606:4700:3032::ac43:ab60, 2606:4700:3037::6815:1d36
Redirect IPs 104.21.29.54, 172.67.171.96, 2606:4700:3032::ac43:ab60, 2606:4700:3037::6815:1d36
Response IP 104.21.29.54
Found Yes
Hash ed8de215481670b4c754bd17deb9f12acbd6d7719ba9cac79856cac2e3ad11f0
SimHash 71555b70da03

Groups

*

Rule Path
Disallow /home/login/
Disallow /Home/login/
Disallow /cgi-bin/*
Disallow /wp-includes/*
Disallow /recommended/*
Disallow /comments/feed/*
Disallow /trackback/*
Disallow /request-sample/*
Disallow /login
Disallow /signup
Disallow /send-enquiry/*

ninjabot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

yeti

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.goldsteinresearch.com/sitemap.xml