kmc.crosswalk.com
robots.txt

Robots Exclusion Standard data for kmc.crosswalk.com

Resource Scan

Scan Details

Site Domain kmc.crosswalk.com
Base Domain crosswalk.com
Scan Status Ok
Last Scan2024-05-17T19:47:59+00:00
Next Scan 2024-05-24T19:47:59+00:00

Last Scan

Scanned2024-05-17T19:47:59+00:00
URL http://kmc.crosswalk.com/robots.txt
Redirect https://www.crosswalk.com/robots.txt
Redirect Domain www.crosswalk.com
Redirect Base crosswalk.com
Domain IPs 104.131.8.93
Redirect IPs 104.24.182.2, 104.24.183.2, 172.67.64.146, 2606:4700:20::6818:b602, 2606:4700:20::6818:b702, 2606:4700:20::ac43:4092
Response IP 104.24.182.2
Found Yes
Hash 0302b1892b2104f59929f7769cd18722ee7014d0e79949e56f689d40416c39c4
SimHash 600a08d1ce32

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.crosswalk.com/sitemaps/sitemap-crosswalk-22.xml
sitemap https://www.crosswalk.com/sitemaps/sitemap-crosswalkvideo-25.xml
sitemap https://www.crosswalk.com/sitemaps/sitemap-crosswalknews-34.xml

Comments

  • robots.txt for https://www.crosswalk.com