debitcards.com.au
robots.txt
Robots Exclusion Standard data for debitcards.com.au
Resource Scan
Scan Details
Site Domain | debitcards.com.au |
Base Domain | debitcards.com.au |
Scan Status | Ok |
Last Scan | 2024-11-10T20:43:42+00:00 |
Next Scan | 2024-11-17T20:43:42+00:00 |
Last Scan
Scanned | 2024-11-10T20:43:42+00:00 |
URL | https://debitcards.com.au/robots.txt |
Domain IPs | 35.189.19.171 |
Response IP | 35.189.19.171 |
Found | Yes |
Hash | 40e327524a2010feb037dfa7969eaad80a3c577d28df57aeede5563b54f8694e |
SimHash | bd416b4701d0 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /images/ |
Disallow | /js/ |
Disallow | /poll/ |
Disallow | /advertise.html |
Disallow | /terms-disclaimer.html |
Disallow | /about-us.html |
Disallow | /form.php |
Disallow | */feed |