strawberry-recipes.com
robots.txt
Robots Exclusion Standard data for strawberry-recipes.com
Resource Scan
Scan Details
| Site Domain | strawberry-recipes.com |
| Base Domain | strawberry-recipes.com |
| Scan Status | Ok |
| Last Scan | 2024-11-04T03:14:04+00:00 |
| Next Scan | 2024-11-11T03:14:04+00:00 |
Last Scan
| Scanned | 2024-11-04T03:14:04+00:00 |
| URL | https://strawberry-recipes.com/robots.txt |
| Domain IPs | 85.13.152.35 |
| Response IP | 85.13.152.35 |
| Found | Yes |
| Hash | 0d40f7441cddacf42e0d6c81ba1a281af1f3410d192c59df4cab435e8792de37 |
| SimHash | 634ad0c55295 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /bin/ |
| Disallow | /dyn/ |
| Disallow | /objects/ |
| Disallow | /help/ |
| Disallow | /no-such-url.html |
| Disallow | /fb/channel.html |
googlebot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /dyn/ |
| Disallow | /help/ |
| Disallow | /no-such-url.html |
| Disallow | /fb/channel.html |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /bin/ |
| Disallow | /dyn/ |
| Disallow | /help/ |
| Disallow | /no-such-url.html |
| Disallow | /fb/channel.html |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /bin/ |
| Disallow | /dyn/ |
| Disallow | /help/ |
| Disallow | /no-such-url.html |
| Disallow | /fb/channel.html |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /bin/ |
| Disallow | /dyn/ |
| Disallow | /help/ |
| Disallow | /fb/channel.html |
| Disallow | /no-such-url.html |
bingbot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /bin/ |
| Disallow | /dyn/ |
| Disallow | /objects/ |
| Disallow | /help/ |
| Disallow | /no-such-url.html |
| Disallow | /fb/channel.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.strawberry-recipes.com/uhlqfUbl.xml |