trespass.com
robots.txt
Robots Exclusion Standard data for trespass.com
Resource Scan
Scan Details
| Site Domain | trespass.com |
| Base Domain | trespass.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-07T11:52:25+00:00 |
| Next Scan | 2024-12-06T11:52:25+00:00 |
Last Successful Scan
| Scanned | 2024-04-18T10:25:53+00:00 |
| URL | https://trespass.com/robots.txt |
| Redirect | https://www.trespass.com/robots.txt |
| Redirect Domain | www.trespass.com |
| Redirect Base | trespass.com |
| Domain IPs | 107.154.215.106, 107.154.80.106 |
| Redirect IPs | 45.60.126.183 |
| Response IP | 45.60.126.183 |
| Found | Yes |
| Hash | d046fd633f5e5cc0b27ecb8640ba998c59a82d5e4d7da8eaec96cfa4e857415e |
| SimHash | 1954985adca4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /app/ |
| Disallow | /bin/ |
| Disallow | /directory/ |
| Disallow | /downloader/ |
| Disallow | /install/ |
| Disallow | /js/ |
| Disallow | /lib/ |
| Disallow | /phpserver/ |
| Disallow | /pkginfo/ |
| Disallow | /private/ |
| Disallow | /setup/ |
| Disallow | /skin/ |
| Disallow | /update/ |
| Disallow | /var/ |
| Disallow | /vendor/ |
| Disallow | /admin/ |
| Disallow | */api/ |
| Disallow | */catalog/category/view/ |
| Disallow | */catalog/product/view/ |
| Disallow | */catalogsearch |
| Disallow | */checkout |
| Disallow | */contacts |
| Disallow | */customer/ |
| Disallow | */newsletter |
| Disallow | */order/ |
| Disallow | */poll/ |
| Disallow | */report/ |
| Disallow | */review/ |
| Disallow | */rma/ |
| Disallow | */sendfriend |
| Disallow | */storelocator/index/view/id/ |
| Disallow | */wishlist |
| Disallow | /cron |
| Disallow | /cron.php |
| Disallow | */cat/ |
| Disallow | /*/pricematch/ |
| Disallow | /*/colour/ |
| Disallow | /*/show/ |
| Disallow | /*/size/ |
| Disallow | */sort-by/ |
| Disallow | /*?*product_list_dir= |
| Disallow | /*?*product_list_limit= |
| Disallow | /*?*product_list_mode= |
| Disallow | /*?*product_list_order= |
| Disallow | /*.php |
| Disallow | /*.sh$ |
| Disallow | /*.CSV$ |
| Disallow | /*.csv$ |
| Disallow | /*.gitignore$ |
| Disallow | /*.sample$ |
| Disallow | /*.sql$ |
| Disallow | /*.zip$ |
| Disallow | /*%26carrier%3D |
| Disallow | /*%26cat%3D |
| Disallow | /*%26color_filter%3D |
| Disallow | /*%26display_size%3D |
| Disallow | /*%26name%3D |
| Disallow | /*%26network%3D |
| Disallow | /*%26os%3D |
| Disallow | /*%26price%3D |
| Disallow | /*%26timestamp%3D |
| Disallow | /*%26top_seller%3D |
| Disallow | /*?SID= |
| Disallow | /*?___SID= |
| Disallow | /*?___store= |
| Disallow | /*?carrier= |
| Disallow | /*?cat= |
| Disallow | /*?color_filter= |
| Disallow | /*?display_size= |
| Disallow | /*?name= |
| Disallow | /*?network= |
| Disallow | /*?os= |
| Disallow | /*?price= |
| Disallow | /*?timestamp= |
| Disallow | /*?top_seller= |
| Disallow | /*?size_legacy=* |
| Disallow | /*?base_color=* |
| Disallow | /*?manufacturer=* |
| Disallow | /*?insulation_type=* |
| Disallow | /*?gender=* |
| Disallow | /*?p=2&size_legacy=* |
| Disallow | *?size_legacy=* |
| Disallow | *?base_color=* |
| Disallow | *?manufacturer=* |
| Disallow | *?insulation_type=* |
| Disallow | *?gender=* |
| Disallow | *?p=2&size_legacy=* |
| Disallow | /?adnetwork= |
| Disallow | /%26adnetwork%3D |
| Disallow | /?affc= |
| Disallow | /%26affc%3D |
| Disallow | /?cto_pld= |
| Disallow | /%26cto_pld%3D |
| Allow | /*?p= |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.trespass.com/sitemap.xml |
Warnings
- 2 invalid lines.
Comments