sourcecodeweb.id
robots.txt
Robots Exclusion Standard data for sourcecodeweb.id
Resource Scan
Scan Details
Site Domain | sourcecodeweb.id |
Base Domain | sourcecodeweb.id |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-05-27T06:51:46+00:00 |
Next Scan | 2025-07-26T06:51:46+00:00 |
Last Successful Scan
Scanned | 2025-03-29T06:45:45+00:00 |
URL | https://sourcecodeweb.id/robots.txt |
Redirect | https://mycoding.id/robots.txt |
Redirect Domain | mycoding.id |
Redirect Base | mycoding.id |
Domain IPs | 151.106.118.235 |
Redirect IPs | 104.21.63.117, 172.67.145.116, 2606:4700:3031::ac43:9174, 2606:4700:3036::6815:3f75 |
Response IP | 172.67.145.116 |
Found | Yes |
Hash | 1eae6044166f46d66e540efac848f2aa692f8473bb12176aab806ad334334ec9 |
SimHash | 453c3de12591 |
Groups
*
Rule | Path |
---|---|
Disallow | /?m=1 |
Disallow | /*.php |
Disallow | /*.html |
Disallow | /cdn-cgi/* |
Disallow | /public/* |
Disallow | /email/* |
Disallow | /checkout/* |
Disallow | /notifications* |
Disallow | /add_to_cart_async* |
Disallow | /set_currency?code=* |
Disallow | /set_locale* |
Disallow | /logout* |
Disallow | /newsletter* |
Disallow | /?redirect=* |
Disallow | /*?set_currency=* |
Disallow | /*?set_locale=* |
Disallow | /*?newsletter=* |
Disallow | /*?redirect=* |
Disallow | /*/*?tags=*%2C* |
Disallow | /*/*/*?tags=*%2C* |
Disallow | /%26page%3D* |
Disallow | /%26sort%3D* |
Disallow | /?page=* |
Disallow | /?sort=* |
Disallow | /*%26page%3D* |
Disallow | /*%26sort%3D* |
Disallow | /*?page=* |
Disallow | /*?sort=* |
Disallow | /*/*%26page%3D* |
Disallow | /*/*%26sort%3D* |
Disallow | /*/*?page=* |
Disallow | /*/*?sort=* |
Disallow | /*/*/*%26page%3D* |
Disallow | /*/*/*%26sort%3D* |
Disallow | /*/*/*?page=* |
Disallow | /*/*/*?sort=* |
Disallow | /*/*/*/*%26page%3D* |
Disallow | /*/*/*/*%26sort%3D* |
Disallow | /*/*/*/*?page=* |
Disallow | /*/*/*/*?sort=* |
Other Records
Field | Value |
---|---|
sitemap | https://mycoding.id/sitemap_index.xml |
sitemap | https://mycoding.id/feed |
sitemap | https://mycoding.id/atom |
sitemap | https://mycoding.id/rss |
Comments