giftly.com
robots.txt
Robots Exclusion Standard data for giftly.com
Resource Scan
Scan Details
| Site Domain | giftly.com |
| Base Domain | giftly.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-03T17:28:09+00:00 |
| Next Scan | 2024-11-01T17:28:09+00:00 |
Last Successful Scan
| Scanned | 2023-06-18T17:11:27+00:00 |
| URL | https://giftly.com/robots.txt |
| Redirect | https://www.giftly.com/robots.txt |
| Redirect Domain | www.giftly.com |
| Redirect Base | giftly.com |
| Domain IPs | 104.26.8.126, 104.26.9.126, 172.67.72.143, 2606:4700:20::681a:87e, 2606:4700:20::681a:97e, 2606:4700:20::ac43:488f |
| Redirect IPs | 104.26.8.126, 104.26.9.126, 172.67.72.143, 2606:4700:20::681a:87e, 2606:4700:20::681a:97e, 2606:4700:20::ac43:488f |
| Response IP | 104.26.8.126 |
| Found | Yes |
| Hash | 6da8e51bce3664c233c7483b484bdb081ad5cd3dccd0db04810e0a6a780c39c2 |
| SimHash | 124c84f1afd0 |
Groups
ahrefsbot
yandexbot
petalbot
aspiegelbot
semrushbot
mj12bot
dotbot
blexbot
dataforseobot
amazonbot
icc-crawler
olbicobot
seekportbot
qwantify
googleother
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /founders-card |
| Disallow | /bold-italic |
| Disallow | /promos/ |
| Disallow | /gift-ideas/detail/ |
| Disallow | /og/account |
| Disallow | /gift/landing/* |
| Disallow | /merchants/* |
| Disallow | /*?spec=treat-gcd |
| Disallow | /gift-cards?category=* |
| Disallow | /support/search?keywords=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.giftly.com/sitemap_v4.xml |