postoj.sk
robots.txt

Robots Exclusion Standard data for postoj.sk

Resource Scan

Scan Details

Site Domain postoj.sk
Base Domain postoj.sk
Scan Status Ok
Last Scan2024-09-23T17:51:19+00:00
Next Scan 2024-09-30T17:51:19+00:00

Last Scan

Scanned2024-09-23T17:51:19+00:00
URL https://postoj.sk/robots.txt
Redirect https://www.postoj.sk/robots.txt
Redirect Domain www.postoj.sk
Redirect Base postoj.sk
Domain IPs 185.65.220.157
Redirect IPs 185.65.220.157
Response IP 185.65.220.157
Found Yes
Hash 0adcc18985eac159b7a1e5618e51659cf8eb36dd920af5e1003efc6b84f87ef0
SimHash 795874672ef1

Groups

facebookexternalhit

Rule Path
Allow /
Disallow /admin/

bingbot

Rule Path
Allow /

gptbot
ccbot
amazonbot

Rule Path
Disallow /

*

Rule Path
Allow /ads.txt
Allow /
Disallow /admin/
Disallow /node_modules/
Disallow /vendor/
Disallow /storage/
Disallow /bootstrap/cache/
Disallow /config/
Disallow /database/
Disallow /resources/
Disallow /routes/
Disallow /tests/
Disallow /env
Disallow /phpinfo
Disallow /phpmyadmin
Disallow /server-status
Disallow /server-info
Disallow /_debugbar/
Disallow /_ignition/
Disallow /telescope/
Disallow /horizon/
Disallow /nova/
Disallow /broadcasting/auth
Disallow /envoyer
Disallow /forge
Disallow /.git
Disallow /.env
Disallow /artisan
Disallow /app/
Disallow /public/build/
Disallow /public/vendor/
Disallow /storage/logs/
Disallow /storage/framework/
Disallow /public/storage
Disallow /public/.htaccess
Disallow /public/php.ini
Disallow /public/favicon.ico
Disallow /public/robots.txt
Disallow /public/web.config
Disallow /*.sql$
Disallow /*.sql.gz$
Disallow /*.sql.zip$
Disallow /*.git$
Disallow /*.hg$
Disallow /*.svn$
Disallow /*.log$
Disallow /*.log.*
Disallow /*.sh
Disallow /*.bat
Disallow /*.exe
Disallow /*.sample
Disallow /*.md
Disallow /*.pdf
Disallow /*.ini
Disallow /*.conf
Disallow /*.config
Disallow /*.yml
Disallow /*.yaml

Comments

  • Additional rules for files that should not be indexed
  • Disallow: /*.txt