surferseo.com
robots.txt
Robots Exclusion Standard data for surferseo.com
Resource Scan
Scan Details
Site Domain | surferseo.com |
Base Domain | surferseo.com |
Scan Status | Ok |
Last Scan | 2024-05-01T13:33:56+00:00 |
Next Scan | 2024-05-31T13:33:56+00:00 |
Last Scan
Scanned | 2024-05-01T13:33:56+00:00 |
URL | https://surferseo.com/robots.txt |
Redirect | https://surferseo.com/robots.txt/ |
Domain IPs | 172.66.40.110, 172.66.43.146, 2606:4700:3108::ac42:286e, 2606:4700:3108::ac42:2b92 |
Response IP | 172.66.43.146 |
Found | Yes |
Hash | 3eb332386788754ceb25be71eaeb44fd085754cb6634b6a92e0731de3f6d2d46 |
SimHash | e120c3e063b0 |
Groups
*
Rule | Path |
---|---|
Disallow | /free-outline-generator/?permalink=* |
Disallow | /dev/ |
Disallow | /design-system/ |
Disallow | /archive/ |