rotogrinders.com
robots.txt
Robots Exclusion Standard data for rotogrinders.com
Resource Scan
Scan Details
Site Domain | rotogrinders.com |
Base Domain | rotogrinders.com |
Scan Status | Ok |
Last Scan | 2024-11-11T07:26:49+00:00 |
Next Scan | 2024-11-18T07:26:49+00:00 |
Last Scan
Scanned | 2024-11-11T07:26:49+00:00 |
URL | https://rotogrinders.com/robots.txt |
Domain IPs | 18.208.46.213, 3.215.112.39, 52.0.118.173 |
Response IP | 18.208.46.213 |
Found | Yes |
Hash | a14d055abded61da248de7f1319062c2c3ba84401a894a4b1315689f427a7662 |
SimHash | fd0c4200fdf3 |
Groups
*
Rule | Path |
---|---|
Disallow | /app |
Disallow | */edit |
Disallow | /grind-downs/ |
Disallow | /api/ |
Disallow | .csv |
Other Records
Field | Value |
---|---|
sitemap | https://rotogrinders.com/sitemaps.xml |
Warnings
- 1 invalid line.