pavluks-trans.com
robots.txt

Robots Exclusion Standard data for pavluks-trans.com

Resource Scan

Scan Details

Site Domain pavluks-trans.com
Base Domain pavluks-trans.com
Scan Status Ok
Last Scan2025-03-16T06:13:20+00:00
Next Scan 2025-04-15T06:13:20+00:00

Last Scan

Scanned2025-03-16T06:13:20+00:00
URL https://pavluks-trans.com/robots.txt
Domain IPs 104.21.14.94, 172.67.158.141, 2606:4700:3035::6815:e5e, 2606:4700:3035::ac43:9e8d
Response IP 104.21.14.94
Found Yes
Hash d9dda14cf73b645b20cb1d5bdcd3ccd0e70436a5a24f7edc7f31291a97b9193c
SimHash e3628f2047b0

Groups

*

Rule Path
Allow /tickets/*/*
Allow /routes/*/*
Allow /routes/*
Allow /news/*
Allow /sitemap
Allow /loyalty-program
Disallow /profile/*
Disallow /success-cash
Disallow /offer-agreement
Disallow /terminal
Disallow /terminal/sharry
Disallow /terminal/ivanets
Disallow /terminal/tamerlan

Other Records

Field Value
sitemap https://pavluks-trans.com/sitemap.xml

Warnings

  • `host` is not a known field.