dearsarkar-u11816.vm.elestio.app
robots.txt

Robots Exclusion Standard data for dearsarkar-u11816.vm.elestio.app

Resource Scan

Scan Details

Site Domain dearsarkar-u11816.vm.elestio.app
Base Domain elestio.app
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-13T13:42:05+00:00
Next Scan 2024-12-12T13:42:05+00:00

Last Successful Scan

Scanned2024-02-23T08:59:16+00:00
URL https://dearsarkar-u11816.vm.elestio.app/robots.txt
Domain IPs 139.84.153.121
Response IP 139.84.153.121
Found Yes
Hash b815efc564ec3e13186784f098d790529def0eaf9d01b0950c65fc2058f08d1f
SimHash 495ec974e775

Groups

*

Rule Path
Allow /

Comments

  • Uncomment the following to block CommonCrawl
  • User-agent: CCBot
  • User-agent: CCBot/2.0
  • User-agent: CCBot/3.1
  • Disallow: /
  • Uncomment the following to block ChatGPT
  • User-agent: GPTBot
  • Disallow: /