johnsonsbabyarabia.com
robots.txt
Robots Exclusion Standard data for johnsonsbabyarabia.com
Resource Scan
Scan Details
| Site Domain | johnsonsbabyarabia.com |
| Base Domain | johnsonsbabyarabia.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T20:52:13+00:00 |
| Next Scan | 2024-11-21T20:52:13+00:00 |
Last Scan
| Scanned | 2024-11-14T20:52:13+00:00 |
| URL | https://www.johnsonsbabyarabia.com/robots.txt |
| Domain IPs | 23.209.46.155, 23.209.46.158, 2600:1413:b000:1c::17d1:2ed3, 2600:1413:b000:1c::17d1:2edb |
| Response IP | 23.52.40.26 |
| Found | Yes |
| Hash | 08911f0c69f9935539c7e42ca2cfa598fa6b14aae72d6fae0f97ba8cd0b7b8aa |
| SimHash | 8f1844124513 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | /_next/ |
| Disallow | /*?bvstate |
| Disallow | /*?bvroute |
| Disallow | /where-to-buy/* |
| Disallow | /*.html |
| Disallow | /*.txt |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.johnsonsbabyarabia.com/sitemap.xml |