agecalculator.me
robots.txt
Robots Exclusion Standard data for agecalculator.me
Resource Scan
Scan Details
Site Domain | agecalculator.me |
Base Domain | agecalculator.me |
Scan Status | Ok |
Last Scan | 2024-09-27T22:18:17+00:00 |
Next Scan | 2024-10-04T22:18:17+00:00 |
Last Scan
Scanned | 2024-09-27T22:18:17+00:00 |
URL | https://agecalculator.me/robots.txt |
Domain IPs | 104.21.12.71, 172.67.193.189, 2606:4700:3032::ac43:c1bd, 2606:4700:3036::6815:c47 |
Response IP | 172.67.193.189 |
Found | Yes |
Hash | c51c0f088322d707b60bbe249b1123511ddad290b1c90881fa33f5ea446de59b |
SimHash | db4a5540f909 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Warnings
- 2 invalid lines.
Comments