roofgiant.com
robots.txt
Robots Exclusion Standard data for roofgiant.com
Resource Scan
Scan Details
Site Domain | roofgiant.com |
Base Domain | roofgiant.com |
Scan Status | Ok |
Last Scan | 2024-10-23T00:05:27+00:00 |
Next Scan | 2024-11-22T00:05:27+00:00 |
Last Scan
Scanned | 2024-10-23T00:05:27+00:00 |
URL | https://roofgiant.com/robots.txt |
Redirect | https://www.roofgiant.com/robots.txt |
Redirect Domain | www.roofgiant.com |
Redirect Base | roofgiant.com |
Domain IPs | 13.225.4.112, 13.225.4.55, 13.225.4.65, 13.225.4.67 |
Redirect IPs | 13.35.185.113, 13.35.185.128, 13.35.185.77, 13.35.185.90 |
Response IP | 13.225.4.67 |
Found | Yes |
Hash | 08ba5be70492a12b04c555139c39c60fca7483d522cbec8c3a916e6026ba3019 |
SimHash | eaa00146c345 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /blog-admin |
Disallow | /ajax |
Disallow | /cgi-bin |
Disallow | /all-products |
Disallow | /checkout |
Disallow | /search/?*%2C* |
Disallow | /search/?*%2C* |
Disallow | /velux-blinds/?*%2C* |
Disallow | /*/?*%2C*%2C* |
Disallow | /*/?*%2C*%2C* |
Disallow | /*/?*&*%2C* |
Disallow | /*/?*%2C*&* |
Disallow | /*/?*&*%2C |
Disallow | /*/?*%2C*&* |
Disallow | /ajax/*? |
Allow | /blog-admin/wp-content/ |
Allow | /image_resize/*?format=png |
Other Records
Field | Value |
---|---|
sitemap | https://www.roofgiant.com/sitemaps/blogs.xml |
sitemap | https://www.roofgiant.com/sitemaps/pages.xml |
sitemap | https://www.roofgiant.com/sitemaps/categories.xml |
sitemap | https://www.roofgiant.com/sitemaps/products.xml |