profitandcost.com
robots.txt
Robots Exclusion Standard data for profitandcost.com
Resource Scan
Scan Details
Site Domain | profitandcost.com |
Base Domain | profitandcost.com |
Scan Status | Ok |
Last Scan | 2024-10-17T11:15:36+00:00 |
Next Scan | 2024-11-16T11:15:36+00:00 |
Last Scan
Scanned | 2024-10-17T11:15:36+00:00 |
URL | https://profitandcost.com/robots.txt |
Domain IPs | 108.156.133.107, 108.156.133.122, 108.156.133.38, 108.156.133.61, 2600:9000:2755:2800:1e:2afa:d5c0:93a1, 2600:9000:2755:4400:1e:2afa:d5c0:93a1, 2600:9000:2755:6a00:1e:2afa:d5c0:93a1, 2600:9000:2755:7c00:1e:2afa:d5c0:93a1, 2600:9000:2755:9600:1e:2afa:d5c0:93a1, 2600:9000:2755:ae00:1e:2afa:d5c0:93a1, 2600:9000:2755:da00:1e:2afa:d5c0:93a1, 2600:9000:2755:fa00:1e:2afa:d5c0:93a1 |
Response IP | 108.156.133.122 |
Found | Yes |
Hash | c90f3ed8a7c25299182fac30ec561bd6cff0b6da447c9ef049b4e81e02283336 |
SimHash | 31189cc0e293 |
Groups
*
Rule | Path |
---|---|
Disallow | /.well-known/* |
Disallow | /dist/* |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |