furaffinity.net
robots.txt
Robots Exclusion Standard data for furaffinity.net
Resource Scan
Scan Details
| Site Domain | furaffinity.net |
| Base Domain | furaffinity.net |
| Scan Status | Ok |
| Last Scan | 2024-06-27T22:00:23+00:00 |
| Next Scan | 2024-07-04T22:00:23+00:00 |
Last Scan
| Scanned | 2024-06-27T22:00:23+00:00 |
| URL | https://furaffinity.net/robots.txt |
| Redirect | https://www.furaffinity.net/robots.txt |
| Redirect Domain | www.furaffinity.net |
| Redirect Base | furaffinity.net |
| Domain IPs | 104.22.46.79, 104.22.47.79, 172.67.40.182, 2606:4700:10::6816:2e4f, 2606:4700:10::6816:2f4f, 2606:4700:10::ac43:28b6 |
| Redirect IPs | 104.22.46.79, 104.22.47.79, 172.67.40.182, 2606:4700:10::6816:2e4f, 2606:4700:10::6816:2f4f, 2606:4700:10::ac43:28b6 |
| Response IP | 104.22.47.79 |
| Found | Yes |
| Hash | 762f8ff5253ef32297ad98ea4b44664c2e408adc9fa99a661ced0e55499b19a4 |
| SimHash | 40bcd06ae3b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /commissions/*/add |
| Disallow | /commissions/*/edit |
| Disallow | /commissions/*/delete |
| Disallow | /commissions/*/move-up |
| Disallow | /commissions/*/move-down |
| Disallow | /commissions/*/normalize-order |
| Disallow | /commissions/*/update-slots |
| Disallow | /plus |
| Disallow | /view/*/edit/ |
| Disallow | /full/*/edit/ |
| Disallow | /fav/ |
| Disallow | /unfav/ |
| Disallow | /view/*/?action=hide_comment |
| Disallow | /full/*/?action=hide_comment |
| Disallow | /view/*/?action=unhide_comment |
| Disallow | /full/*/?action=unhide_comment |
| Disallow | /journal/*/edit/ |
| Disallow | /journal/*/?action=hide_comment |
| Disallow | /journal/*/?action=unhide_comment |
| Disallow | /me |
| Disallow | /watch/ |
| Disallow | /unwatch/ |
| Disallow | /block/ |
| Disallow | /unblock/ |
| Disallow | /submit/ |
| Disallow | /replyto/ |
| Disallow | /controls/ |
| Disallow | /avatar/ |
| Disallow | /message/ |
| Disallow | /viewmessage/ |
| Disallow | /newpm/ |
| Disallow | /msg/ |
| Disallow | /user/history/ |
| Disallow | /online |
| Disallow | /stats/ |
| Disallow | /search |
| Disallow | /administration/ |
| Disallow | /adminaction/ |
| Disallow | /register/verify/ |
| Disallow | /register/finalize |
| Disallow | /register/welcome/ |
| Disallow | /captcha.jpg$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |