Log In Sign Up

whatai.cc
robots.txt

Robots Exclusion Standard data for whatai.cc

Resource Scan

Scan Details

Site Domain whatai.cc
Base Domain whatai.cc
Scan Status Ok
Last Scan2026-03-02T04:28:41+00:00
Next Scan 2026-03-09T04:28:41+00:00

Last Scan

Scanned2026-03-02T04:28:41+00:00
URL https://whatai.cc/robots.txt
Domain IPs 104.21.64.217, 172.67.187.228, 2606:4700:3030::6815:40d9, 2606:4700:3037::ac43:bbe4
Response IP 104.21.64.217
Found Yes
Hash d05baa0df1832c2e62f9308df2d49435ac4d670754bf55fafe95361c1a06f14f
SimHash 7934d80b4e90

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

slurp

Rule Path
Disallow /

teoma

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

yahoo-blogs/v3.9

Rule Path
Disallow /

psbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /
Disallow /bookmark/
Disallow /go/
Disallow /user
Disallow /hotnews
Back to top

Other Records

Field Value
sitemap https://whatai.cc/wp-sitemap-posts-post-1.xml
sitemap https://whatai.cc/wp-sitemap-posts-sites-1.xml
sitemap https://whatai.cc/wp-sitemap-taxonomies-category-1.xml
sitemap https://whatai.cc/wp-sitemap-taxonomies-post_tag-1.xml
sitemap https://whatai.cc/wp-sitemap-taxonomies-post_tag-12.xml
sitemap https://whatai.cc/wp-sitemap-taxonomies-sitetag-1.xml
sitemap https://whatai.cc/sitemap-news.xml
sitemap https://whatai.cc/wp-sitemap.xml
Back to top

Comments

  • XML Sitemap & Google News version 5.4.9 - https://status301.net/wordpress-plugins/xml-sitemap-feed/
Back to top