dealfront.com
robots.txt
Robots Exclusion Standard data for dealfront.com
Resource Scan
Scan Details
Site Domain | dealfront.com |
Base Domain | dealfront.com |
Scan Status | Ok |
Last Scan | 2024-11-13T19:13:00+00:00 |
Next Scan | 2024-12-13T19:13:00+00:00 |
Last Scan
Scanned | 2024-11-13T19:13:00+00:00 |
URL | https://dealfront.com/robots.txt |
Redirect | https://www.dealfront.com/robots.txt |
Redirect Domain | www.dealfront.com |
Redirect Base | dealfront.com |
Domain IPs | 108.157.254.120, 108.157.254.127, 108.157.254.48, 108.157.254.73 |
Redirect IPs | 13.35.238.106, 13.35.238.23, 13.35.238.50, 13.35.238.98, 2600:9000:2200:1600:19:5ce8:37c0:93a1, 2600:9000:2200:1e00:19:5ce8:37c0:93a1, 2600:9000:2200:4400:19:5ce8:37c0:93a1, 2600:9000:2200:7600:19:5ce8:37c0:93a1, 2600:9000:2200:aa00:19:5ce8:37c0:93a1, 2600:9000:2200:c600:19:5ce8:37c0:93a1, 2600:9000:2200:d400:19:5ce8:37c0:93a1, 2600:9000:2200:dc00:19:5ce8:37c0:93a1 |
Response IP | 13.35.238.50 |
Found | Yes |
Hash | 3f3848b6818aa43831b22acb897a40be8e7e15331a414f0e8ae6e6841f71aace |
SimHash | 6000eee0e990 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /us/ |
Disallow | /us/pricing-web-visitors/ |
Disallow | /us/target/ |
Disallow | /de/us/target/ |
Disallow | /404/ |
Disallow | /de/404/ |
Disallow | /danke-download-gtm-guide-dach/ |
Disallow | /de/danke-download-gtm-guide-dach/ |
Disallow | /danke-download-wirtschaftszweige-wz-code-liste/ |
Disallow | /de/danke-download-wirtschaftszweige-wz-code-liste/ |
Disallow | /guide-thank-you/ |
Disallow | /de/guide-thank-you/ |
Disallow | /thank-you-gtm-guide-benelux/ |
Disallow | /de/thank-you-gtm-guide-benelux/ |
Disallow | /thank-you-gtm-guide-dach/ |
Disallow | /de/thank-you-gtm-guide-dach/ |
Disallow | /thank-you-gtm-guide-nordics/ |
Disallow | /de/thank-you-gtm-guide-nordics/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.dealfront.com/sitemap-index.xml |
Warnings
- `host` is not a known field.