paydayloansnewjersey.net
robots.txt
Robots Exclusion Standard data for paydayloansnewjersey.net
Resource Scan
Scan Details
Site Domain | paydayloansnewjersey.net |
Base Domain | paydayloansnewjersey.net |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 1/29/2025, 1:14:08 AM |
Next Scan | 4/29/2025, 1:14:08 AM |
Last Successful Scan
Scanned | 6/16/2023, 10:30:26 PM |
URL | https://paydayloansnewjersey.net/robots.txt |
Domain IPs | 104.21.38.212, 172.67.168.125, 2606:4700:3030::6815:26d4, 2606:4700:3037::ac43:a87d |
Response IP | 104.21.38.212 |
Found | Yes |
Hash | c383eea760a3979c492d7c74290c18a98dc7e42edfe2731ff5f4b57e910700d5 |
SimHash | 0b69aa87a210 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /wp-content/plugins |
Disallow | /wp-content/cache |
Disallow | /wp-content/themes |
Disallow | /wp-trackback |
Disallow | /wp-feed |
Disallow | /wp-comments |
Disallow | */trackback |
Disallow | */feed |
Disallow | */comments |
Disallow | /out/* |
Disallow | */page/* |
Disallow | /faq |
Disallow | /*utm* |
Disallow | /?attachment_id* |
Disallow | */?* |
Other Records
Field | Value |
---|---|
sitemap | https://paydayloansnewjersey.net/sitemap.xml |
Warnings
- `host` is not a known field.