fordeal.com
robots.txt

Robots Exclusion Standard data for fordeal.com

Resource Scan

Scan Details

Site Domain fordeal.com
Base Domain fordeal.com
Scan Status Ok
Last Scan2024-09-14T08:32:53+00:00
Next Scan 2024-09-21T08:32:53+00:00

Last Scan

Scanned2024-09-14T08:32:53+00:00
URL https://fordeal.com/robots.txt
Redirect https://www.fordeal.com/robots.txt
Redirect Domain www.fordeal.com
Redirect Base fordeal.com
Domain IPs 104.18.20.145, 104.18.21.145
Redirect IPs 104.18.20.145, 104.18.21.145
Response IP 104.18.20.145
Found Yes
Hash e537e8350cf7f4ee4f2d6a124be6fe229b17fc42f18cb11dd1a2d3e17e426cf2
SimHash 254b18b17698

Groups

*

Rule Path
Allow /$
Allow /.well-known/
Allow /*.xml$
Allow /sitemap
Allow /ar-SA/
Allow /en-SA/
Allow /ar-AE/
Allow /en-AE/
Allow /ar-KW/
Allow /en-KW/
Allow /ar-QA/
Allow /en-QA/
Allow /ar-BH/
Allow /en-BH/
Allow /ar-OM/
Allow /en-OM/
Allow /ar-JO/
Allow /en-GB/
Allow /fr-FR/
Allow /de-DE/
Allow /it-IT/
Allow /es-ES/
Allow /nl-NL/
Allow /en-AU/
Allow /en-US/
Allow /ar-EG/
Allow /ar-MA/
Allow /en-IN/
Allow /no-NO/
Allow /pl-PL/
Allow /el-GR/
Allow /cs-CZ/
Allow /sk-CZ/
Allow /sv-SE/
Allow /pt-PT/
Allow /hu-HU/
Allow /da-DK/
Allow /fi-FI/
Allow /sv-FI/
Allow /sk-SK/
Allow /hr-HR/
Allow /sl-SI/
Allow /ru-RU/
Allow /pt-BR/
Allow /es-MX/
Allow /he-IL/
Allow /ar-IQ/
Disallow /checkout/
Disallow /cart/
Disallow /view-history/
Disallow /balance/
Disallow /address/
Disallow /order/
Disallow /profile/
Disallow /devh5

youdaobot

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

xenu

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.fordeal.com/sitemap/home.xml
sitemap https://www.fordeal.com/sitemap/category.xml
sitemap https://www.fordeal.com/product.xml
sitemap https://www.fordeal.com/search.xml
sitemap https://www.fordeal.com/review.xml