websitebuilderinsider.com
robots.txt
Robots Exclusion Standard data for websitebuilderinsider.com
Resource Scan
Scan Details
| Site Domain | websitebuilderinsider.com |
| Base Domain | websitebuilderinsider.com |
| Scan Status | Ok |
| Last Scan | 2024-09-24T10:07:10+00:00 |
| Next Scan | 2024-10-01T10:07:10+00:00 |
Last Scan
| Scanned | 2024-09-24T10:07:10+00:00 |
| URL | https://websitebuilderinsider.com/robots.txt |
| Domain IPs | 96.126.110.156 |
| Response IP | 96.126.110.156 |
| Found | Yes |
| Hash | 071a5e498c2dc1ce24581cedcf491f51c605145b3ea901c73b37b422552cb151 |
| SimHash | 4a60d952fbb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /Go/ |
| Disallow | /go/ |
| Disallow | /author/ |
| Disallow | /tag/ |
| Disallow | /contact-us/ |
| Disallow | /about-us/ |
| Disallow | /disclosure/ |
| Disallow | /articles/ |
| Disallow | /website-builder-comparison/ |
| Disallow | /reviews/ |
| Disallow | /websitebuilder/ |