johnvschultz.com
robots.txt
Robots Exclusion Standard data for johnvschultz.com
Resource Scan
Scan Details
Site Domain | johnvschultz.com |
Base Domain | johnvschultz.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-10T20:40:52+00:00 |
Next Scan | 2024-10-09T20:40:52+00:00 |
Last Successful Scan
Scanned | 2024-05-20T20:39:22+00:00 |
URL | https://johnvschultz.com/robots.txt |
Redirect | https://www.johnvschultz.com/robots.txt |
Redirect Domain | www.johnvschultz.com |
Redirect Base | johnvschultz.com |
Domain IPs | 23.59.168.146, 23.59.168.147 |
Redirect IPs | 23.59.168.146, 23.59.168.147 |
Response IP | 23.59.168.146 |
Found | Yes |
Hash | ed0a4505d826e3f968a79b10c662f749cbfb2d15258c5cbaf55aaa50072b3d24 |
SimHash | 65809571fd1a |
Groups
*
Rule | Path |
---|---|
Disallow | /AkamaiSR/ |
Disallow | /app_data/ |
Disallow | /app_globalresources/ |
Disallow | /app_localthemes/ |
Disallow | /app_themes/ |
Disallow | /checkout/ |
Disallow | /shoppingcart/ |
Disallow | /account/ |
Disallow | /styles/ |
Disallow | /bin/ |
Disallow | /img/ |
Disallow | /product/print/ |
Disallow | /custompage/contactusformsubmit |
Disallow | /custompage/surveyformsubmit |
Disallow | /easy-pass/processvisitstore |
Disallow | /product/getproductpartialview/ |
Disallow | /error/status/ |
Disallow | /api/ |
Disallow | /mvcapi/ |
msnbot
Rule | Path |
---|---|
Disallow | /AkamaiSR/ |
Disallow | /app_data/ |
Disallow | /app_globalresources/ |
Disallow | /app_localthemes/ |
Disallow | /app_themes/ |
Disallow | /checkout/ |
Disallow | /shoppingcart/ |
Disallow | /account/ |
Disallow | /styles/ |
Disallow | /bin/ |
Disallow | /img/ |
Disallow | /product/print/ |
Disallow | /custompage/contactusformsubmit |
Disallow | /custompage/surveyformsubmit |
Disallow | /easy-pass/processvisitstore |
Disallow | /product/getproductpartialview/ |
Disallow | /error/status/ |
Disallow | /api/ |
Disallow | /mvcapi/ |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://www.levinfurniture.com/sitemap.xml |