merge.dev
robots.txt
Robots Exclusion Standard data for merge.dev
Resource Scan
Scan Details
| Site Domain | merge.dev |
| Base Domain | merge.dev |
| Scan Status | Ok |
| Last Scan | 2024-10-31T17:35:04+00:00 |
| Next Scan | 2024-11-30T17:35:04+00:00 |
Last Scan
| Scanned | 2024-10-31T17:35:04+00:00 |
| URL | https://merge.dev/robots.txt |
| Redirect | https://www.merge.dev/robots.txt |
| Redirect Domain | www.merge.dev |
| Redirect Base | merge.dev |
| Domain IPs | 104.18.12.117, 104.18.13.117, 2606:4700::6812:c75, 2606:4700::6812:d75 |
| Redirect IPs | 52.197.0.54, 52.199.221.217, 54.178.223.218 |
| Response IP | 54.178.223.218 |
| Found | Yes |
| Hash | 4c5e50fbe4d2b75c29dc96612b8a15f01990de618e97f40be3b908b36cbbb6af |
| SimHash | 700d1444af93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /abm-lp/ |
| Disallow | /category-use-case-cards/ |
| Disallow | /offers/ |
| Disallow | /sponsorships/ |
| Disallow | /event-sign-up/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.merge.dev/sitemap.xml |