anabolizzanti-naturali.it
robots.txt

Robots Exclusion Standard data for anabolizzanti-naturali.it

Resource Scan

Scan Details

Site Domain anabolizzanti-naturali.it
Base Domain anabolizzanti-naturali.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-10T03:35:13+00:00
Next Scan 2024-07-09T03:35:13+00:00

Last Successful Scan

Scanned2024-02-18T03:33:52+00:00
URL https://anabolizzanti-naturali.it/robots.txt
Domain IPs 186.2.166.147
Response IP 186.2.166.147
Found Yes
Hash 10c04139605e922ac02cffc1e957fd096c3f47856b4cb5884820838a9f018491
SimHash 0c0dcb4d6d31

Groups

*

Rule Path
Disallow /*route%3Daccount/
Disallow /*route%3Daffiliate/
Disallow /*route%3Dcheckout/
Disallow /*route%3Dproduct/search
Disallow /index.php?route=product%2Fproduct*&manufacturer_id=
Disallow /admin
Disallow /system
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter=
Disallow /*%26filter%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*?route=module%2Fmega_filter=
Allow *.css*
Allow *.gif*
Allow *.jpeg*
Allow *.jpg*
Allow *.js*
Allow *.pdf*
Allow *.png*
Allow *.svg*
Allow *.webp*

ccbot
chatgpt-user
facebookbot
gptbot
gptbot
google-extended
omgili
omgilibot
petalbot
yandexbot
anthropic-ai
cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://anabolizzanti-naturali.it/sitemap.xml
sitemap https://anabolizzanti-naturali.it/video-sitemap.xml