gitp.nl
robots.txt

Robots Exclusion Standard data for gitp.nl

Resource Scan

Scan Details

Site Domain gitp.nl
Base Domain gitp.nl
Scan Status Ok
Last Scan2024-07-04T16:00:19+00:00
Next Scan 2024-07-11T16:00:19+00:00

Last Scan

Scanned2024-07-04T16:00:19+00:00
URL https://gitp.nl/robots.txt
Redirect https://www.gitp.nl/robots.txt
Redirect Domain www.gitp.nl
Redirect Base gitp.nl
Domain IPs 95.101.111.133, 95.101.111.162
Redirect IPs 2600:1413:b000:6::17d5:2bce, 2600:1413:b000:6::17d5:2bde, 96.17.96.17, 96.17.96.31
Response IP 23.44.4.179
Found Yes
Hash dca619f85893f8be4ef1c1510a00e6db9c85898b1d79578b386b4494be6e3517
SimHash 831a19763f33

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Disallow /login/
Disallow *?

Other Records

Field Value
sitemap https://www.gitp.nl/sitemaps-1-sitemap.xml
sitemap https://www.gitp.nl/en/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.gitp.nl/
  • live - don't allow web crawlers to index cpresources/ or vendor/