mykhel.com
robots.txt

Robots Exclusion Standard data for mykhel.com

Resource Scan

Scan Details

Site Domain mykhel.com
Base Domain mykhel.com
Scan Status Ok
Last Scan2024-05-25T03:02:19+00:00
Next Scan 2024-06-01T03:02:19+00:00

Last Scan

Scanned2024-05-25T03:02:19+00:00
URL https://mykhel.com/robots.txt
Redirect https://www.mykhel.com/robots.txt
Redirect Domain www.mykhel.com
Redirect Base mykhel.com
Domain IPs 104.18.4.113, 104.18.5.113, 2606:4700::6812:471, 2606:4700::6812:571
Redirect IPs 104.18.4.113, 104.18.5.113, 2606:4700::6812:471, 2606:4700::6812:571
Response IP 104.18.4.113
Found Yes
Hash c14f6571194451a7ec44e32c2ef61b438b4f1f07e9a5eff4b1586349d356c600
SimHash 692cdfa44dd5

Groups

*

Rule Path
Allow /
Disallow /temp/
Disallow /amphtml/temp/
Disallow /404.html
Disallow /scripts/
Disallow /*?referer=*
Disallow /*?asid=*
Disallow /*?utm=*
Disallow /*?ref_source=*
Disallow /dynamic_html_includes/*
Disallow /common_dynamic/html/*
Disallow /src/*
Disallow /videos/
Disallow /videos/amphtml/
Disallow /videos/amphtml/*
Disallow /videos/tagfeeds/*

googlebot-news

Rule Path
Allow /
Disallow /partner-content/

mediapartners-google

Rule Path
Allow /

grapeshot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.mykhel.com/sitemap_index.xml
sitemap https://www.mykhel.com/sitemap-latest.xml
sitemap https://www.mykhel.com/sitemap_news.xml
sitemap https://www.mykhel.com/sitemap-images-index.xml
sitemap https://www.mykhel.com/sitemap-webstories.xml