house.pl
robots.txt
Robots Exclusion Standard data for house.pl
Resource Scan
Scan Details
Site Domain | house.pl |
Base Domain | house.pl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-10T18:59:12+00:00 |
Next Scan | 2025-02-08T18:59:12+00:00 |
Last Successful Scan
Scanned | 2024-03-23T18:55:49+00:00 |
URL | https://house.pl/robots.txt |
Redirect | https://www.housebrand.com/robots.txt |
Redirect Domain | www.housebrand.com |
Redirect Base | housebrand.com |
Domain IPs | 104.21.34.52, 172.67.198.141, 2606:4700:3030::ac43:c68d, 2606:4700:3031::6815:2234 |
Redirect IPs | 23.215.7.32, 23.215.7.7, 2600:1413:b000:1b::17d7:707, 2600:1413:b000:1b::17d7:720 |
Response IP | 23.52.171.203 |
Found | Yes |
Hash | 214cf1f06d2fcefdb4943d307f23289994403b0753e65807105bfc180fe4a461 |
SimHash | 428998346e46 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/*/checkout/ |
Disallow | /*/*/customer/ |
Disallow | /*/*/wishlist/ |
Disallow | /*/*/js/ |
Disallow | /*/*/ajx/ |
Disallow | /*/*/ajax/ |
Disallow | /*/*/zsales/ |
Disallow | /*/*/ordertracking/ |
Disallow | /*/*/sizetable/ |
Disallow | /*/*/metrics/ |
Disallow | */page_action/aggregate |
Disallow | */ajax/aggregate |
Disallow | */jserrors/aggregate |
Disallow | */page_view_event/aggregate |
Disallow | */session_trace/aggregate |
Disallow | */spa/aggregate |
Disallow | */page_view_timing/aggregate |
Disallow | /*/*/order/ |
Disallow | /*/*/myaccount/ |
Disallow | /ho/en/ |
Disallow | /*/*/apple/session/create/ |
Disallow | /*1test* |
Disallow | /*2test* |
Disallow | /*3test* |
Disallow | /*4test* |
Disallow | /*5test* |
Disallow | /*6test* |
Disallow | /*7test* |
Disallow | /*8test* |
Disallow | /*9test* |
Disallow | /*0test* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://static.housebrand.com/sitemaps/sitemap.xml.gz |