classified.rep-am.com
robots.txt
Robots Exclusion Standard data for classified.rep-am.com
Resource Scan
Scan Details
Site Domain | classified.rep-am.com |
Base Domain | rep-am.com |
Scan Status | Ok |
Last Scan | 2024-10-22T09:45:07+00:00 |
Next Scan | 2024-11-21T09:45:07+00:00 |
Last Scan
Scanned | 2024-10-22T09:45:07+00:00 |
URL | https://classified.rep-am.com/robots.txt |
Domain IPs | 209.59.187.75 |
Response IP | 209.59.187.75 |
Found | Yes |
Hash | 808594256e4b728b494d1055c64e1e1cbc03562c7296cbae26af5d30a8267d05 |
SimHash | 6848ab9146b0 |
Groups
*
Rule | Path |
---|---|
Allow | /ads.txt |
*
Rule | Path |
---|---|
Allow | / |
*
Rule | Path |
---|---|
Disallow | /ads/ |
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Comments