top5-websitebuilders.com
robots.txt
Robots Exclusion Standard data for top5-websitebuilders.com
Resource Scan
Scan Details
Site Domain | top5-websitebuilders.com |
Base Domain | top5-websitebuilders.com |
Scan Status | Ok |
Last Scan | 2024-11-17T21:38:25+00:00 |
Next Scan | 2024-12-17T21:38:25+00:00 |
Last Scan
Scanned | 2024-11-17T21:38:25+00:00 |
URL | https://top5-websitebuilders.com/robots.txt |
Domain IPs | 108.157.254.31, 108.157.254.62, 108.157.254.75, 108.157.254.86 |
Response IP | 108.157.254.62 |
Found | Yes |
Hash | b7839434fdf4023b3199c84b73f11e5b8ff2b9e41f11ab490995450dd81d8a7a |
SimHash | 6131cb69fb11 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp/wp-admin |
Disallow | /wp/wp-includes |
Disallow | /app |
Disallow | /compare/* |
Allow | /app/*.js |
Allow | /app/*.css |
Allow | /app/*.jpg |
Allow | /app/*.png |
Allow | /app/*/fonts |
Allow | /app/*.svg |
Allow | /app/*.gif |