expert.top
robots.txt

Robots Exclusion Standard data for expert.top

Resource Scan

Scan Details

Site Domain expert.top
Base Domain expert.top
Scan Status Ok
Last Scan4/5/2025, 8:55:58 PM
Next Scan 5/5/2025, 8:55:58 PM

Last Scan

Scanned4/5/2025, 8:55:58 PM
URL https://expert.top/robots.txt
Domain IPs 104.21.18.107, 172.67.181.153, 2606:4700:3034::6815:126b, 2606:4700:3035::ac43:b599
Response IP 172.67.181.153
Found Yes
Hash 822d9c7d39acd5ed4feaac78cf0fb96118b39be443733bb2ff8526bea3b24a2b
SimHash 6970c6160617

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /*?
Disallow /?s=
Allow /wp-includes/*.css
Allow /wp-includes/*.js
Allow /wp-content/plugins/*.css
Allow /wp-content/plugins/*.js
Allow /*.css
Allow /*.js

Other Records

Field Value
sitemap https://expert.top/sitemap.xml
sitemap https://expert.top/sitemap.html