alireza271.ir
robots.txt
Robots Exclusion Standard data for alireza271.ir
Resource Scan
Scan Details
| Site Domain | alireza271.ir |
| Base Domain | alireza271.ir |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-10-17T00:13:30+00:00 |
| Next Scan | 2024-12-16T00:13:30+00:00 |
Last Successful Scan
| Scanned | 2024-08-19T00:07:14+00:00 |
| URL | https://alireza271.ir/robots.txt |
| Domain IPs | 81.28.12.12 |
| Response IP | 81.28.12.12 |
| Found | Yes |
| Hash | faebb45d00216b1688a335ba4a9690ab43a2e9d42836f74461d0ad49215e0336 |
| SimHash | dd2eab8cb881 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bitesize/search$ |
| Disallow | /bitesize/search/ |
| Disallow | /bitesize/search? |
| Disallow | /cbbc/search/ |
| Disallow | /cbbc/search$ |
| Disallow | /cbbc/search? |
| Disallow | /cbeebies/search/ |
| Disallow | /cbeebies/search$ |
| Disallow | /cbeebies/search? |
| Disallow | /chwilio/ |
| Disallow | /chwilio$ |
| Disallow | /chwilio? |
| Disallow | /education/blocks$ |
| Disallow | /education/blocks/ |
| Disallow | /newsround |
| Disallow | /search/ |
| Disallow | /search$ |
| Disallow | /search? |
| Disallow | /food/favourites |
| Disallow | /food/search*?* |
| Disallow | /food/recipes/search*?* |
| Disallow | /education/my$ |
| Disallow | /education/my/ |
| Disallow | /bitesize/my$ |
| Disallow | /bitesize/my/ |
| Disallow | /food/recipes/*/shopping-list |
| Disallow | /food/menus/*/shopping-list |
| Disallow | /news/0 |
| Disallow | /sport/alpha/ |
| Disallow | /ugc$ |
| Disallow | /ugc/ |
| Disallow | /ugcsupport$ |
| Disallow | /ugcsupport/ |
| Disallow | /userinfo/ |
| Disallow | /userinfo |
| Disallow | /u5llnop$ |
| Disallow | /u5llnop/ |
| Disallow | /sounds/search$ |
| Disallow | /sounds/search/ |
| Disallow | /sounds/search? |
| Disallow | /ws/includes |
| Disallow | /radio/imda |
| Disallow | /storyworks/preview/* |
| Disallow | /rd/search$ |
| Disallow | /rd/search/ |
| Disallow | /rd/search? |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bbc.com/sitemaps/https-index-com-archive.xml |
| sitemap | https://www.bbc.com/sitemaps/https-index-com-news.xml |
| sitemap | https://www.bbc.com/sitemaps/https-index-com-archive_video.xml |
| sitemap | https://www.bbc.com/sitemaps/https-index-com-video.xml |
| sitemap | https://www.bbc.com/sitemaps/sitemap-com-ws-topics.xml |
| sitemap | https://www.bbc.com/sport/sitemap.xml |
| sitemap | https://www.bbc.com/sitemaps/sitemap-com-ws-topics.xml |
| sitemap | https://www.bbc.com/afrique/sitemap.xml |
| sitemap | https://www.bbc.com/arabic/sitemap.xml |
| sitemap | https://www.bbc.com/bengali/sitemap.xml |
| sitemap | https://www.bbc.com/burmese/sitemap.xml |
| sitemap | https://www.bbc.com/gahuza/sitemap.xml |
| sitemap | https://www.bbc.com/hausa/sitemap.xml |
| sitemap | https://www.bbc.com/hindi/sitemap.xml |
| sitemap | https://www.bbc.com/indonesia/sitemap.xml |
| sitemap | https://www.bbc.com/mundo/sitemap.xml |
| sitemap | https://www.bbc.com/pashto/sitemap.xml |
| sitemap | https://www.bbc.com/persian/sitemap.xml |
| sitemap | https://www.bbc.com/portuguese/sitemap.xml |
| sitemap | https://www.bbc.com/russian/sitemap.xml |
| sitemap | https://www.bbc.com/swahili/sitemap.xml |
| sitemap | https://www.bbc.com/tajik/sitemap.xml |
| sitemap | https://www.bbc.com/turkce/sitemap.xml |
| sitemap | https://www.bbc.com/ukchina/simp/sitemap.xml |
| sitemap | https://www.bbc.com/ukrainian/sitemap.xml |
| sitemap | https://www.bbc.com/urdu/sitemap.xml |
| sitemap | https://www.bbc.com/uzbek/sitemap.xml |
| sitemap | https://www.bbc.com/vietnamese/sitemap.xml |
| sitemap | https://www.bbc.com/zhongwen/simp/sitemap.xml |
| sitemap | https://www.bbc.com/zhongwen/trad/sitemap.xml |
| sitemap | https://www.bbc.com/bbcx/index_sitemap.xml |
Comments