aosom.pt
robots.txt

Robots Exclusion Standard data for aosom.pt

Resource Scan

Scan Details

Site Domain aosom.pt
Base Domain aosom.pt
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-12T18:44:41+00:00
Next Scan 2024-09-10T18:44:41+00:00

Last Successful Scan

Scanned2023-02-07T15:57:35+00:00
URL https://aosom.pt/robots.txt
Redirect https://www.aosom.pt:443/robots.txt
Redirect Domain www.aosom.pt
Redirect Base aosom.pt
Domain IPs 35.156.116.146, 52.58.230.208
Redirect IPs 2600:1413:b000:14::b857:c158, 2600:1413:b000:14::b857:c15b, 72.247.81.113, 72.247.81.177
Response IP 72.247.81.177
Found Yes
Hash 2978a0c8f6c35f9fac44e84f9acfd2039f3e62a4716da7b97d3fb5df88a3f1b9
SimHash cd8cceb0aea7

Groups

*

Rule Path
Disallow /?*
Disallow /payment/
Disallow /plap/
Disallow /rest/
Disallow /business/
Disallow /item/null~*
Disallow /item/~*

amazonproductdiscoverybot

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.aosom.pt/sitemap.xml