sourcecodeweb.id
robots.txt

Robots Exclusion Standard data for sourcecodeweb.id

Resource Scan

Scan Details

Site Domain sourcecodeweb.id
Base Domain sourcecodeweb.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-05-27T06:51:46+00:00
Next Scan 2025-07-26T06:51:46+00:00

Last Successful Scan

Scanned2025-03-29T06:45:45+00:00
URL https://sourcecodeweb.id/robots.txt
Redirect https://mycoding.id/robots.txt
Redirect Domain mycoding.id
Redirect Base mycoding.id
Domain IPs 151.106.118.235
Redirect IPs 104.21.63.117, 172.67.145.116, 2606:4700:3031::ac43:9174, 2606:4700:3036::6815:3f75
Response IP 172.67.145.116
Found Yes
Hash 1eae6044166f46d66e540efac848f2aa692f8473bb12176aab806ad334334ec9
SimHash 453c3de12591

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /?m=1
Disallow /*.php
Disallow /*.html
Disallow /cdn-cgi/*
Disallow /public/*
Disallow /email/*
Disallow /checkout/*
Disallow /notifications*
Disallow /add_to_cart_async*
Disallow /set_currency?code=*
Disallow /set_locale*
Disallow /logout*
Disallow /newsletter*
Disallow /?redirect=*
Disallow /*?set_currency=*
Disallow /*?set_locale=*
Disallow /*?newsletter=*
Disallow /*?redirect=*
Disallow /*/*?tags=*%2C*
Disallow /*/*/*?tags=*%2C*
Disallow /%26page%3D*
Disallow /%26sort%3D*
Disallow /?page=*
Disallow /?sort=*
Disallow /*%26page%3D*
Disallow /*%26sort%3D*
Disallow /*?page=*
Disallow /*?sort=*
Disallow /*/*%26page%3D*
Disallow /*/*%26sort%3D*
Disallow /*/*?page=*
Disallow /*/*?sort=*
Disallow /*/*/*%26page%3D*
Disallow /*/*/*%26sort%3D*
Disallow /*/*/*?page=*
Disallow /*/*/*?sort=*
Disallow /*/*/*/*%26page%3D*
Disallow /*/*/*/*%26sort%3D*
Disallow /*/*/*/*?page=*
Disallow /*/*/*/*?sort=*

Other Records

Field Value
sitemap https://mycoding.id/sitemap_index.xml
sitemap https://mycoding.id/feed
sitemap https://mycoding.id/atom
sitemap https://mycoding.id/rss

Comments

  • Hello search engine
  • I am robots.txt
  • I am very happy to be crawled