arabiclantern.com
robots.txt
Robots Exclusion Standard data for arabiclantern.com
Resource Scan
Scan Details
| Site Domain | arabiclantern.com |
| Base Domain | arabiclantern.com |
| Scan Status | Ok |
| Last Scan | 2025-05-27T09:34:38+00:00 |
| Next Scan | 2025-06-03T09:34:38+00:00 |
Last Scan
| Scanned | 2025-05-27T09:34:38+00:00 |
| URL | https://arabiclantern.com/robots.txt |
| Domain IPs | 2a02:4780:39:5930:7b48:76c1:aed6:4f20, 84.32.84.219 |
| Response IP | 91.108.100.220 |
| Found | Yes |
| Hash | 9fec13cc2ee22edc351f52c601565bc7e2d1411da37b483d325866b77b152c86 |
| SimHash | 6e30d3a0f512 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/feed$ |
| Disallow | /page/ |
| Disallow | /?s= |
| Disallow | /?post_type |
| Disallow | /?p= |
| Disallow | /amp/ |
| Disallow | /tag/ |
| Disallow | /search |
| Disallow | /author/ |
| Disallow | /wp- |
| Allow | /*.js$ |
| Allow | /*.css$ |
| Allow | /*.jpg$ |
| Allow | /*.png$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /*.pdf$ |
| Allow | /*.js? |
| Allow | /*.css? |
| Allow | /*.jpg? |
| Allow | /*.png? |
| Allow | /*.gif? |
| Allow | /*.webp? |
| Allow | /*.pdf? |