remove-bg.io
robots.txt
Robots Exclusion Standard data for remove-bg.io
Resource Scan
Scan Details
| Site Domain | remove-bg.io |
| Base Domain | remove-bg.io |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-20T00:42:48+00:00 |
| Next Scan | 2025-11-03T00:42:48+00:00 |
Last Successful Scan
| Scanned | 2025-10-05T00:36:39+00:00 |
| URL | https://remove-bg.io/robots.txt |
| Domain IPs | 172.66.40.217, 172.66.43.39, 2606:4700:3108::ac42:28d9, 2606:4700:3108::ac42:2b27 |
| Response IP | 172.66.40.217 |
| Found | Yes |
| Hash | b26979cb1f59419871ad7f334ad9ab600f16f0f16d483bb7a37a16a556e3e033 |
| SimHash | 7206d8d2ad3a |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | /_next/ |
| Disallow | /workbox-* |
| Disallow | /*.json$ |
| Disallow | /sw.js |
| Disallow | /error |
| Allow | /*?locale=* |
| Allow | /*?search=* |
| Allow | /*?category=* |
| Allow | /*?tool=* |
| Disallow | /*?token=* |
| Disallow | /*?session=* |
| Disallow | /*?testMode=* |
| Disallow | /*?debug=* |
| Allow | /*/upload |
| Allow | /*/tools/ |
| Allow | /*/blog/ |
| Allow | /*/help/ |
| Allow | /*/faq |
| Allow | /*/about-us |
| Allow | /*/status |
| Allow | /*/privacy-policy |
| Allow | /*/terms-of-service |
| Allow | /*/bulk-background-remover |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /*.css$ |
| Allow | /*.js$ |
| Allow | /*.jpg$ |
| Allow | /*.jpeg$ |
| Allow | /*.png$ |
| Allow | /*.webp$ |
| Allow | /*.svg$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://remove-bg.io/sitemap.xml |
| sitemap | https://remove-bg.io/sitemap-images.xml |
| sitemap | https://remove-bg.io/sitemap-news.xml |
| sitemap | https://remove-bg.io/sitemap-index.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments