betterware.pl
robots.txt
Robots Exclusion Standard data for betterware.pl
Resource Scan
Scan Details
Site Domain | betterware.pl |
Base Domain | betterware.pl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-04-07T15:25:07+00:00 |
Next Scan | 2025-06-06T15:25:07+00:00 |
Last Successful Scan
Scanned | 2025-01-15T15:24:05+00:00 |
URL | http://betterware.pl/robots.txt |
Redirect | https://adultwork.com//robots.txt |
Redirect Domain | adultwork.com |
Redirect Base | adultwork.com |
Domain IPs | 198.50.252.65 |
Redirect IPs | 104.18.40.137, 172.64.147.119 |
Response IP | 104.18.40.137 |
Found | Yes |
Hash | f2702ff7b89e725778a984530bdd414b953df166e1d89ce8dfe64ff6405447dc |
SimHash | fc504286e012 |
Groups
*
Rule | Path |
---|---|
Disallow | /ios/src/ |
Disallow | /android/src/ |
Disallow | /webapp/src/ |
Disallow | /XMLDataSources/ |
Disallow | /SetApiCookie.asp |
Disallow | /SCPage.asp |
Disallow | /dlgSCPage.asp |
Disallow | /Advisors/default.asp |