amazingtalker.com.my
robots.txt
Robots Exclusion Standard data for amazingtalker.com.my
Resource Scan
Scan Details
Site Domain | amazingtalker.com.my |
Base Domain | amazingtalker.com.my |
Scan Status | Ok |
Last Scan | 2024-09-24T16:37:44+00:00 |
Next Scan | 2024-10-08T16:37:44+00:00 |
Last Scan
Scanned | 2024-09-24T16:37:44+00:00 |
URL | https://amazingtalker.com.my/robots.txt |
Redirect | https://www.amazingtalker.com.my/robots.txt |
Redirect Domain | www.amazingtalker.com.my |
Redirect Base | amazingtalker.com.my |
Domain IPs | 99.86.38.10, 99.86.38.124, 99.86.38.4, 99.86.38.51 |
Redirect IPs | 18.155.68.120, 18.155.68.4, 18.155.68.42, 18.155.68.61 |
Response IP | 18.155.68.120 |
Found | Yes |
Hash | 1644d32722f75a385427791cd91d6a49a22b6c0cbd575f41be3c37d80c7bdb53 |
SimHash | 2968db40e613 |
Groups
facebookexternalhit
Rule | Path |
---|---|
Disallow | /*?*city= |
Disallow | /*/*?city= |
Disallow | /tutors-debug |
Disallow | /webview/ |
Disallow | /_Incapsula_Resource |
Disallow | /sdk.js |
Disallow | /courses-legacy |
Disallow | /landing |
Disallow | /_s/videos/ |
Disallow | /entrances/ |
Disallow | /int-a/ |
Disallow | /messenger/ |
Disallow | /users/* |
Disallow | /*/users/* |
Disallow | /learning-tickets/* |
Disallow | /ratings/*/* |
Disallow | /blog/tag/* |
Disallow | /blog/category/* |
Disallow | /dashboard/* |
Disallow | /u/* |
Disallow | /t/* |
Other Records
Field | Value |
---|---|
crawl-delay | 300 |
gptbot
Rule | Path |
---|---|
Disallow | /*?*city= |
Disallow | /*/*?city= |
Disallow | /tutors-debug |
Disallow | /webview/ |
Disallow | /_Incapsula_Resource |
Disallow | /sdk.js |
Disallow | /courses-legacy |
Disallow | /landing |
Disallow | /_s/videos/ |
Disallow | /entrances/ |
Disallow | /int-a/ |
Disallow | /messenger/ |
Disallow | /users/* |
Disallow | /*/users/* |
Disallow | /learning-tickets/* |
Disallow | /ratings/*/* |
Disallow | /blog/tag/* |
Disallow | /blog/category/* |
Disallow | /dashboard/* |
Disallow | /u/* |
Disallow | /t/* |
Other Records
Field | Value |
---|---|
crawl-delay | 300 |
claudebot
Rule | Path |
---|---|
Disallow | /*?*city= |
Disallow | /*/*?city= |
Disallow | /tutors-debug |
Disallow | /webview/ |
Disallow | /_Incapsula_Resource |
Disallow | /sdk.js |
Disallow | /courses-legacy |
Disallow | /landing |
Disallow | /_s/videos/ |
Disallow | /entrances/ |
Disallow | /int-a/ |
Disallow | /messenger/ |
Disallow | /users/* |
Disallow | /*/users/* |
Disallow | /learning-tickets/* |
Disallow | /ratings/*/* |
Disallow | /blog/tag/* |
Disallow | /blog/category/* |
Disallow | /dashboard/* |
Disallow | /u/* |
Disallow | /t/* |
Other Records
Field | Value |
---|---|
crawl-delay | 300 |
amazonbot
Rule | Path |
---|---|
Disallow | /*?*city= |
Disallow | /*/*?city= |
Disallow | /tutors-debug |
Disallow | /webview/ |
Disallow | /_Incapsula_Resource |
Disallow | /sdk.js |
Disallow | /courses-legacy |
Disallow | /landing |
Disallow | /_s/videos/ |
Disallow | /entrances/ |
Disallow | /int-a/ |
Disallow | /messenger/ |
Disallow | /users/* |
Disallow | /*/users/* |
Disallow | /learning-tickets/* |
Disallow | /ratings/*/* |
Disallow | /blog/tag/* |
Disallow | /blog/category/* |
Disallow | /dashboard/* |
Disallow | /u/* |
Disallow | /t/* |
Other Records
Field | Value |
---|---|
crawl-delay | 300 |
*
Rule | Path |
---|---|
Disallow | /tutors-debug |
Disallow | /webview/ |
Disallow | /_Incapsula_Resource |
Disallow | /sdk.js |
Disallow | /courses-legacy |
Disallow | /landing |
Disallow | /_s/videos/ |
Disallow | /entrances/ |
Disallow | /int-a/ |
Disallow | /messenger/ |
Disallow | /users/* |
Disallow | /*/users/* |
Disallow | /learning-tickets/* |
Disallow | /ratings/*/* |
Disallow | /blog/tag/* |
Disallow | /blog/category/* |
Disallow | /dashboard/* |
Disallow | /u/* |
Disallow | /t/* |