shukran.com
robots.txt

Robots Exclusion Standard data for shukran.com

Resource Scan

Scan Details

Site Domain shukran.com
Base Domain shukran.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-12T02:59:29+00:00
Next Scan 2024-11-26T02:59:29+00:00

Last Successful Scan

Scanned2023-08-09T22:00:11+00:00
URL https://shukran.com/robots.txt
Domain IPs 104.18.114.6, 104.18.115.6, 2606:4700::6812:7206, 2606:4700::6812:7306
Response IP 104.18.115.6
Found Yes
Hash d5990ba8b658dce066edb5808b5f0acbf344fcc4e7a38b0a3de883b55c7fd2bc
SimHash 3b038923c392

Groups

*

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

etaospider

Rule Path
Disallow /
Disallow /inbox
Disallow /my-account
Disallow /profile-setting
Disallow /receipts
Disallow /verify-your-account
Disallow /one-last-step

Other Records

Field Value
sitemap https://www.shukran.com/sitemap-BrandCategory.xml
sitemap https://www.shukran.com/sitemap-OfferCategory.xml
sitemap https://www.shukran.com/sitemap-News.xml
sitemap https://www.shukran.com/sitemap-Stores.xml
sitemap https://www.shukran.com/sitemap-Events.xml
sitemap https://www.shukran.com/sitemap-Offers.xml
sitemap https://www.shukran.com/sitemap-Brands.xml
sitemap https://www.shukran.com/sitemap-OffersCategory.xml
sitemap https://www.shukran.com/sitemap-BrandsCategory.xml