mobapp-cdn.klsescreener.com
robots.txt

Robots Exclusion Standard data for mobapp-cdn.klsescreener.com

Resource Scan

Scan Details

Site Domain mobapp-cdn.klsescreener.com
Base Domain klsescreener.com
Scan Status Ok
Last Scan2024-11-14T02:19:35+00:00
Next Scan 2024-11-21T02:19:35+00:00

Last Scan

Scanned2024-11-14T02:19:35+00:00
URL https://mobapp-cdn.klsescreener.com/robots.txt
Domain IPs 104.21.4.225, 172.67.132.142, 2606:4700:3033::6815:4e1, 2606:4700:3034::ac43:848e
Response IP 172.67.132.142
Found Yes
Hash 16c09c482b1092f031fb111e05805db58e3044e0a724453badd65e80cbd4379a
SimHash f15ac8626bb1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Comments

  • User-agent: MJ12bot
  • Disallow: /