Log In Sign Up

sudul.my.id
robots.txt

Robots Exclusion Standard data for sudul.my.id

Resource Scan

Scan Details

Site Domain sudul.my.id
Base Domain sudul.my.id
Scan Status Ok
Last Scan2025-08-04T13:09:31+00:00
Next Scan 2025-08-11T13:09:31+00:00

Last Scan

Scanned2025-08-04T13:09:31+00:00
URL https://sudul.my.id/robots.txt
Domain IPs 104.21.33.245, 172.67.151.251, 2606:4700:3034::ac43:97fb, 2606:4700:3036::6815:21f5
Response IP 104.21.33.245
Found Yes
Hash 88305796bdbf69d69f7fa728c7d345e392b1908a091301afd27679e01d3d5ea0
SimHash feb5590c7706

Groups

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Back to top

Warnings

  • 14 invalid lines.
Back to top