fetching2.ir
robots.txt
Robots Exclusion Standard data for fetching2.ir
Resource Scan
Scan Details
| Site Domain | fetching2.ir |
| Base Domain | fetching2.ir |
| Scan Status | Ok |
| Last Scan | 2025-10-28T00:08:30+00:00 |
| Next Scan | 2025-11-04T00:08:30+00:00 |
Last Scan
| Scanned | 2025-10-28T00:08:30+00:00 |
| URL | https://fetching2.ir/robots.txt |
| Domain IPs | 104.21.3.66, 172.67.153.119, 2606:4700:3034::ac43:9977, 2606:4700:3035::6815:342 |
| Response IP | 104.21.3.66 |
| Found | Yes |
| Hash | cd36adcf8077f4b38d28c0d812983f7cb52f450f7540c561dd9624dbc51ad312 |
| SimHash | ec9272f24cf2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /academic/profile |
| Disallow | /academic/search |
| Disallow | /account/ |
| Disallow | /aclick |
| Disallow | /alink |
| Disallow | /amp/ |
| Allow | /api/maps/ |
| Disallow | /api/ |
| Disallow | /bfp/search |
| Disallow | /bing-site-safety |
| Disallow | /blogs/search/ |
| Disallow | /ck/ |
| Disallow | /copilotsearch?q= |
| Disallow | /cr$ |
| Disallow | /cr? |
| Disallow | /entities/search |
| Disallow | /entityexplore$ |
| Disallow | /entityexplore? |
| Disallow | /fd/ |
| Disallow | /fun/api/ |
| Disallow | /fun/g/ |
| Disallow | /history |
| Disallow | /hotel/reviews? |
| Disallow | /hotels/search |
| Disallow | /HpImageArchive.aspx |
| Disallow | /hpm |
| Disallow | /hpmob |
| Disallow | /images/async/? |
| Disallow | /images/async? |
| Disallow | /images/hosted/? |
| Disallow | /images/hosted/search? |
| Disallow | /images/hosted? |
| Disallow | /images/search%3F |
| Disallow | /images/search%5C |
| Disallow | /images/search/? |
| Disallow | /images/search? |
| Disallow | /images/searchbyimage |
| Disallow | /images? |
| Disallow | /inboxcommerce |
| Disallow | /local |
| Disallow | /maps/adsendpoint |
| Disallow | /merchant/reviews? |
| Disallow | /notifications/ |
| Disallow | /offers/proxy/dealsserver/api/log |
| Disallow | /offers/proxy/dealsserver/buy |
| Disallow | /ping |
| Disallow | /product/reviews? |
| Disallow | /profile/history? |
| Disallow | /proFile/history? |
| Disallow | /Proxy.ashx |
| Disallow | /results |
| Disallow | /rewardsapp/ |
| Disallow | /search |
| Disallow | /Search |
| Disallow | /settings |
| Disallow | /shenghuo |
| Allow | /shop$ |
| Allow | /shop/ |
| Disallow | /shop/collections |
| Disallow | /shop/productpage |
| Disallow | /shop/topics |
| Allow | /shop? |
| Disallow | /social/search? |
| Disallow | /spbasic |
| Disallow | /spresults |
| Disallow | /static/ |
| Disallow | /th$ |
| Disallow | /th? |
| Disallow | /translator/?ref= |
| Disallow | /travel/api |
| Disallow | /travel/css |
| Disallow | /travel/flight/flightSearch |
| Disallow | /travel/flight/flightSearchAction |
| Disallow | /travel/flight/search/? |
| Disallow | /travel/flight/search? |
| Disallow | /travel/flights |
| Disallow | /travel/flight-search |
| Disallow | /travel/hotel/hotelMiniSearchRequest |
| Disallow | /travel/hotel/hotelSearch |
| Disallow | /travel/hotels/checkout |
| Disallow | /travel/hotels/detail |
| Disallow | /travel/hotels/search/? |
| Disallow | /travel/hotels/search? |
| Disallow | /travel/hotel-search |
| Disallow | /travel/scripts |
| Disallow | /travel/secure |
| Disallow | /url |
| Disallow | /videos/browsing |
| Disallow | /videos/explore |
| Disallow | /videos/favorites |
| Disallow | /videos/feed |
| Disallow | /videos/music |
| Disallow | /videos/trending |
| Disallow | /widget/cr |
| Disallow | /widget/entity/search/? |
| Disallow | /widget/render |
| Disallow | /widget/snapshot |
| Disallow | /work |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bing.com/sitemap.xml |