Log In Sign Up

letscml.id
robots.txt

Robots Exclusion Standard data for letscml.id

Resource Scan

Scan Details

Site Domain letscml.id
Base Domain letscml.id
Scan Status Ok
Last Scan2025-12-08T13:36:35+00:00
Next Scan 2026-01-07T13:36:35+00:00

Last Scan

Scanned2025-12-08T13:36:35+00:00
URL https://letscml.id/robots.txt
Domain IPs 57.155.58.153
Response IP 57.155.58.153
Found Yes
Hash fdd2b388d1acc11def3833a8f0e83f82c3316ba17263d26ff9d76ab4887df1ae
SimHash 9412d924c3f7

Groups

python-requests

Rule Path
Disallow /

python-httpx

Rule Path
Disallow /

aiohttp

Rule Path
Disallow /

urllib

Rule Path
Disallow /

urllib2

Rule Path
Disallow /

curl

Rule Path
Disallow /

wget

Rule Path
Disallow /

okhttp

Rule Path
Disallow /

java

Rule Path
Disallow /

httpclient

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

php

Rule Path
Disallow /

ruby

Rule Path
Disallow /

perl

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

powershell

Rule Path
Disallow /

node-fetch

Rule Path
Disallow /

axios

Rule Path
Disallow /
Back to top

Comments

  • Programmatic bots (these will ignore robots.txt but included anyway)
Back to top