justbaat.ai
robots.txt
Robots Exclusion Standard data for justbaat.ai
Resource Scan
Scan Details
Site Domain | justbaat.ai |
Base Domain | justbaat.ai |
Scan Status | Ok |
Last Scan | 2024-11-15T01:33:06+00:00 |
Next Scan | 2024-11-22T01:33:06+00:00 |
Last Scan
Scanned | 2024-11-15T01:33:06+00:00 |
URL | https://justbaat.ai/robots.txt |
Domain IPs | 104.21.42.243, 172.67.213.110, 2606:4700:3031::ac43:d56e, 2606:4700:3036::6815:2af3 |
Response IP | 172.67.213.110 |
Found | Yes |
Hash | 9591de0af98935709c9d3d2b6b5d7810c479348509e3379c9d16a6ac65849b24 |
SimHash | 3804dc326fac |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /ajax/ |
Disallow | /feed/ |
Disallow | *feed/ |
Disallow | /css/ |
Disallow | /js/ |
Disallow | /fonts/ |
Disallow | /author/ |
Disallow | /comments/ |
Disallow | /wp-content/ |
Disallow | /privacy-policy/ |
Disallow | /notification/ |
Disallow | /adx |
Disallow | /expert.justbaat.com/ |
Disallow | /author/team-justbaat-ai/ |
Disallow | /wp-sitemap-users-1.xml |
Disallow | /wp-sitemap-taxonomies-category-1.xml |
Disallow | /wp-sitemap-posts-post-1.xml |
Disallow | /wp-sitemap-posts-page-1.xml |
Disallow | /wp-sitemap.xml |
Disallow | /wp-sitemap.xsl |
Disallow | /wp-sitemap-index.xsl |
Disallow | /wp-sitemap-index.xsl |
Disallow | /category/uncategorized/ |
Allow | /blog/category/ |
Disallow | /blog/test/ |
Allow | /blog/ |
Other Records
Field | Value |
---|---|
sitemap | https://justbaat.com/sitemap_index.xml |