Log In Sign Up

platform.test.cnet.com
robots.txt

Robots Exclusion Standard data for platform.test.cnet.com

Resource Scan

Scan Details

Site Domain platform.test.cnet.com
Base Domain cnet.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-03-25T23:47:16+00:00
Next Scan 2026-04-08T23:47:16+00:00

Last Successful Scan

Scanned2026-02-15T20:31:41+00:00
URL https://platform.test.cnet.com/robots.txt
Domain IPs 192.0.66.155, 2a04:fa87:fffd::c000:429b
Response IP 192.0.66.155
Found Yes
Hash 6e3a39c0002205f10db4569a49df47c0a4dac3fdc5a2962420f4ed42cd986388
SimHash 47027f402bb6

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://platform.test.cnet.com/wp-sitemap.xml
sitemap https://platform.test.cnet.com/sitemaps/article/index.xml
sitemap https://platform.test.cnet.com/sitemaps/best.xml
sitemap https://platform.test.cnet.com/sitemaps/gallery/index.xml
sitemap https://platform.test.cnet.com/sitemaps/how-to/index.xml
sitemap https://platform.test.cnet.com/sitemaps/news.xml
sitemap https://platform.test.cnet.com/sitemaps/review/index.xml
sitemap https://platform.test.cnet.com/sitemaps/static.xml
sitemap https://platform.test.cnet.com/sitemaps/updating_story/index.xml
sitemap https://platform.test.cnet.com/sitemaps/video/index.xml
sitemap https://platform.test.cnet.com/sitemap.xml
sitemap https://platform.test.cnet.com/sitemaps/day-map/index.xml
sitemap https://platform.test.cnet.com/sitemaps/pages-sitemap/index.xml
sitemap https://platform.test.cnet.com/sitemaps/test-include-images/index.xml
sitemap https://platform.test.cnet.com/sitemaps/testing-categories/index.xml
sitemap https://platform.test.cnet.com/sitemaps/years-sitemaps/index.xml
sitemap https://platform.test.cnet.com/sitemaps/zahra-map-1/index.xml
Back to top

Comments

  • Sitemap archive
Back to top