netwes.com
robots.txt

Robots Exclusion Standard data for netwes.com

Resource Scan

Scan Details

Site Domain netwes.com
Base Domain netwes.com
Scan Status Ok
Last Scan2025-12-12T22:31:52+00:00
Next Scan 2025-12-26T22:31:52+00:00

Last Scan

Scanned2025-12-12T22:31:52+00:00
URL https://netwes.com/robots.txt
Redirect https://www.netwes.com/robots.txt
Redirect Domain www.netwes.com
Redirect Base netwes.com
Domain IPs 34.194.151.116, 52.1.23.37
Redirect IPs 18.209.232.76, 54.227.236.125
Response IP 18.209.232.76
Found Yes
Hash a1bc3e1962750dd1ef4f3d9dc374a8a95e53cd8b122afc2ed6939ac39f177927
SimHash 6948c411c701

Groups

googleboy

Rule Path
Allow /

*

Rule Path
Disallow /silver/*.jsp

*

Rule Path
Disallow /custom/*.jsp

*

Rule Path
Disallow /api/*.jsp

*

Rule Path
Disallow /theme/*/*.jsp

Other Records

Field Value
sitemap https://www.netwes.com/sitemap.xml