nytransitmuseumstore.com
robots.txt
Robots Exclusion Standard data for nytransitmuseumstore.com
Resource Scan
Scan Details
Site Domain | nytransitmuseumstore.com |
Base Domain | nytransitmuseumstore.com |
Scan Status | Ok |
Last Scan | 2025-02-15T01:34:55+00:00 |
Next Scan | 2025-03-17T01:34:55+00:00 |
Last Scan
Scanned | 2025-02-15T01:34:55+00:00 |
URL | https://nytransitmuseumstore.com/robots.txt |
Redirect | https://www.nytransitmuseumstore.com/robots.txt |
Redirect Domain | www.nytransitmuseumstore.com |
Redirect Base | nytransitmuseumstore.com |
Domain IPs | 198.23.181.45 |
Redirect IPs | 198.23.181.45 |
Response IP | 198.23.181.45 |
Found | Yes |
Hash | 3520434bee3c3131920d50184fb085427b618a195652242d28ae33e46ac02dad |
SimHash | 473ed908c212 |
Groups
*
Rule | Path |
---|---|
Disallow | /app/ |
Disallow | /bin/ |
Disallow | /dev/ |
Disallow | /lib/ |
Disallow | /phpserver/ |
Disallow | /pub/ |
Disallow | /pkginfo/ |
Disallow | /report/ |
Disallow | /var/ |
Disallow | /*SID%3D |
Disallow | /*.php$ |
Disallow | /*?dir* |
Disallow | /*?dir=desc |
Disallow | /*?dir=asc |
Disallow | /*?limit=all |
Disallow | /*?mode |
Disallow | /search/ |
Disallow | /catalogsearch/ |
Disallow | /*?q=* |
Disallow | /catalog/ |
Disallow | /catalog/category/view/ |
Disallow | /catalog/product/view/ |
Disallow | /catalog/product_compare/ |
Disallow | /sendfriend/ |
Disallow | /review/ |
Disallow | /customer/ |
Disallow | /checkout/ |
Disallow | /onestepcheckout/ |
Comments