aquarius-dir.com
robots.txt
Robots Exclusion Standard data for aquarius-dir.com
Resource Scan
Scan Details
Site Domain | aquarius-dir.com |
Base Domain | aquarius-dir.com |
Scan Status | Ok |
Last Scan | 2024-11-18T01:35:09+00:00 |
Next Scan | 2024-11-25T01:35:09+00:00 |
Last Scan
Scanned | 2024-11-18T01:35:09+00:00 |
URL | https://aquarius-dir.com/robots.txt |
Domain IPs | 104.21.11.6, 172.67.147.77, 2606:4700:3032::6815:b06, 2606:4700:3033::ac43:934d |
Response IP | 172.67.147.77 |
Found | Yes |
Hash | 82b9c6c7d2cfc632a2749290634a99f8cc86d4309d1624b102c78eebb0c065f8 |
SimHash | 45d0c9d3427d |
Groups
*
Rule | Path |
---|---|
Disallow | /*page |
Disallow | /*search |
Disallow | /*p%3D |
Disallow | /*gosearch.php |
Disallow | /*s%3D |
Disallow | /*id%3D |
Disallow | /*rss.php |
Disallow | /*sitemap.xml |
Disallow | /*sitemap.xml.gz |
Disallow | /*urllist.txt |
Disallow | /*?p= |
Disallow | /*?s= |
Disallow | /*?id= |
Disallow | /*cgi-bin/ |
Disallow | /*cat_id |
Disallow | /*search.php? |
Disallow | /*% |
Disallow | /*submit.php |
Disallow | /*detail.php |
Disallow | /*details.php |
Disallow | /*details |
Disallow | /*detail |
Disallow | /*_1 |
Disallow | /*_2 |
Disallow | /*_3 |
Disallow | /*_4 |
Disallow | /*_5 |
Disallow | /*_6 |
Disallow | /*_7 |
Disallow | /*_8 |
Disallow | /*_9 |