mykhel.com
robots.txt
Robots Exclusion Standard data for mykhel.com
Resource Scan
Scan Details
Site Domain | mykhel.com |
Base Domain | mykhel.com |
Scan Status | Ok |
Last Scan | 2024-05-25T03:02:19+00:00 |
Next Scan | 2024-06-01T03:02:19+00:00 |
Last Scan
Scanned | 2024-05-25T03:02:19+00:00 |
URL | https://mykhel.com/robots.txt |
Redirect | https://www.mykhel.com/robots.txt |
Redirect Domain | www.mykhel.com |
Redirect Base | mykhel.com |
Domain IPs | 104.18.4.113, 104.18.5.113, 2606:4700::6812:471, 2606:4700::6812:571 |
Redirect IPs | 104.18.4.113, 104.18.5.113, 2606:4700::6812:471, 2606:4700::6812:571 |
Response IP | 104.18.4.113 |
Found | Yes |
Hash | c14f6571194451a7ec44e32c2ef61b438b4f1f07e9a5eff4b1586349d356c600 |
SimHash | 692cdfa44dd5 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /temp/ |
Disallow | /amphtml/temp/ |
Disallow | /404.html |
Disallow | /scripts/ |
Disallow | /*?referer=* |
Disallow | /*?asid=* |
Disallow | /*?utm=* |
Disallow | /*?ref_source=* |
Disallow | /dynamic_html_includes/* |
Disallow | /common_dynamic/html/* |
Disallow | /src/* |
Disallow | /videos/ |
Disallow | /videos/amphtml/ |
Disallow | /videos/amphtml/* |
Disallow | /videos/tagfeeds/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.mykhel.com/sitemap_index.xml |
sitemap | https://www.mykhel.com/sitemap-latest.xml |
sitemap | https://www.mykhel.com/sitemap_news.xml |
sitemap | https://www.mykhel.com/sitemap-images-index.xml |
sitemap | https://www.mykhel.com/sitemap-webstories.xml |