thebudgetreport.com
robots.txt
Robots Exclusion Standard data for thebudgetreport.com
Resource Scan
Scan Details
Site Domain | thebudgetreport.com |
Base Domain | thebudgetreport.com |
Scan Status | Ok |
Last Scan | 2024-10-17T09:37:36+00:00 |
Next Scan | 2024-11-16T09:37:36+00:00 |
Last Scan
Scanned | 2024-10-17T09:37:36+00:00 |
URL | https://thebudgetreport.com/robots.txt |
Domain IPs | 108.156.133.20, 108.156.133.56, 108.156.133.60, 108.156.133.91, 2600:9000:2755:1600:a:a05a:55c0:93a1, 2600:9000:2755:4800:a:a05a:55c0:93a1, 2600:9000:2755:6800:a:a05a:55c0:93a1, 2600:9000:2755:7400:a:a05a:55c0:93a1, 2600:9000:2755:aa00:a:a05a:55c0:93a1, 2600:9000:2755:b400:a:a05a:55c0:93a1, 2600:9000:2755:c400:a:a05a:55c0:93a1, 2600:9000:2755:ce00:a:a05a:55c0:93a1 |
Response IP | 108.156.133.91 |
Found | Yes |
Hash | 968f6edc852828d6ae6cfc6918c2e9b2a992a0a59170fc39236419f018933258 |
SimHash | 38089cc0ea9a |
Groups
*
Rule | Path |
---|---|
Disallow | /.well-known/* |
Disallow | /dist/* |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |