Log In Sign Up

custojusto.pt
robots.txt

Robots Exclusion Standard data for custojusto.pt

Resource Scan

Scan Details

Site Domain custojusto.pt
Base Domain custojusto.pt
Scan Status Ok
Last Scan2024-11-04T15:50:05+00:00
Next Scan 2024-11-11T15:50:05+00:00

Last Scan

Scanned2024-11-04T15:50:05+00:00
URL https://custojusto.pt/robots.txt
Redirect https://www.custojusto.pt/robots.txt
Redirect Domain www.custojusto.pt
Redirect Base custojusto.pt
Domain IPs 104.22.76.124, 104.22.77.124, 172.67.28.147, 2606:4700:10::6816:4c7c, 2606:4700:10::6816:4d7c, 2606:4700:10::ac43:1c93
Redirect IPs 104.22.76.124, 104.22.77.124, 172.67.28.147, 2606:4700:10::6816:4c7c, 2606:4700:10::6816:4d7c, 2606:4700:10::ac43:1c93
Response IP 104.22.76.124
Found Yes
Hash d1f861aad714e979cf04346ca6f71781cc87d5efabc17853d3fb26ecd9c3cbf3
SimHash 2859507acee8

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /ar/
Disallow /cp/
Disallow /ma/
Disallow /sp/
Disallow /support/
Disallow /vf/
Disallow /thumbs/
Disallow /pg/
Disallow /adreply?id*
Disallow /testemunhos?*
Disallow /payments/*
Disallow /cdn-cgi/
Disallow /newvi/*
Disallow /aw/
Disallow /st/
Disallow /redir/
Disallow /iredir/
Disallow /*mc?id=*
Disallow /*f%3Dc
Disallow /*ros%3D*
Disallow /*shopreply?*
Disallow /destaques/*?source=vi*
Disallow /user/
Disallow /modal/
Disallow /servicos/
Disallow /404
Disallow /payments*
Disallow /*si%3D0*
Disallow /*si%3D1*
Disallow /*user%3D*
Disallow /*?o=*
Disallow /*%26o%3D*
Disallow /*?gone=*
Disallow /*%26gone%3D*
Back to top

Other Records

Field Value
sitemap https://www.custojusto.pt/sitemap_list.xml
sitemap https://www.custojusto.pt/sitemap_index.xml
sitemap https://www.custojusto.pt/sitemap_static.xml
sitemap https://www.custojusto.pt/sitemap.xml
Back to top

Comments

  • It is expressly forbidden to use spiders or other
  • automated methods to access CustoJusto.pt. Only if custojusto.pt
  • has given special permit such access is allowed.
  • all
  • payments
  • filter-price
  • filter-images
  • user random urls
  • paginations
  • gone param
Back to top