clerk-tech.com
robots.txt
Robots Exclusion Standard data for clerk-tech.com
Resource Scan
Scan Details
| Site Domain | clerk-tech.com |
| Base Domain | clerk-tech.com |
| Scan Status | Ok |
| Last Scan | 2024-10-28T02:21:37+00:00 |
| Next Scan | 2024-11-27T02:21:37+00:00 |
Last Scan
| Scanned | 2024-10-28T02:21:37+00:00 |
| URL | https://clerk-tech.com/robots.txt |
| Domain IPs | 192.0.78.153, 192.0.78.239 |
| Response IP | 192.0.78.239 |
| Found | Yes |
| Hash | a931c8115edb8d01e8e6cd9b975cfa55bc3425177a5612e06f383b4d99ff0dda |
| SimHash | 6919c205c793 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /cgi-bin/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /*?* |
| Allow | /wp-admin/admin-ajax.php |
| Allow | *.js |
| Allow | *.css |
Other Records
| Field | Value |
|---|---|
| sitemap | https://clerk-tech.com/sitemap_index.xml |
| sitemap | https://clerk-tech.com/post-sitemap.xml |
| sitemap | https://clerk-tech.com/page-sitemap.xml |
| sitemap | https://clerk-tech.com/testimonial-sitemap.xml |