klsescreener.com
robots.txt

Robots Exclusion Standard data for klsescreener.com

Resource Scan

Scan Details

Site Domain klsescreener.com
Base Domain klsescreener.com
Scan Status Ok
Last Scan2024-05-31T13:27:06+00:00
Next Scan 2024-06-07T13:27:06+00:00

Last Scan

Scanned2024-05-31T13:27:06+00:00
URL https://klsescreener.com/robots.txt
Redirect https://www.klsescreener.com/robots.txt
Redirect Domain www.klsescreener.com
Redirect Base klsescreener.com
Domain IPs 220.158.201.36
Redirect IPs 104.21.4.225, 172.67.132.142, 2606:4700:3033::6815:4e1, 2606:4700:3034::ac43:848e
Response IP 172.67.132.142
Found Yes
Hash 16c09c482b1092f031fb111e05805db58e3044e0a724453badd65e80cbd4379a
SimHash f15ac8626bb1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Comments

  • User-agent: MJ12bot
  • Disallow: /