ask42.us
robots.txt
Robots Exclusion Standard data for ask42.us
Resource Scan
Scan Details
| Site Domain | ask42.us |
| Base Domain | ask42.us |
| Scan Status | Ok |
| Last Scan | 2025-03-23T05:10:21+00:00 |
| Next Scan | 2025-04-22T05:10:21+00:00 |
Last Scan
| Scanned | 2025-03-23T05:10:21+00:00 |
| URL | https://ask42.us/robots.txt |
| Domain IPs | 104.21.40.30, 172.67.174.223, 2606:4700:3030::ac43:aedf, 2606:4700:3036::6815:281e |
| Response IP | 104.21.40.30 |
| Found | Yes |
| Hash | df85ea115a97217e3a3c504df94be6b8f1e8fb6d7b71335632b5acbfc6c52fbd |
| SimHash | 2919bd68ef51 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /404/ |
| Disallow | /*?* |
| Allow | /static/ |
| Disallow | /static/other/* |
| Allow | /files/ |
| Disallow | /media/ |
| Disallow | /ajax/ |
| Disallow | /management/ |
| Disallow | /show_course/ |
| Disallow | /show_chapter/ |
| Disallow | /course/android-introduction/ |
| Disallow | /course/it-marketing/ |
| Disallow | /course/react-js/ |
| Disallow | /course/data-processing/ |
| Disallow | /candidate-profile/ |
| Disallow | /telegram-auth/ |
| Disallow | /logout/ |
| Disallow | /show_article/ssh_keys/ |
| Disallow | /show_article/sql_join_in_examples/ |
| Disallow | /article/ssh-keys/ |
| Disallow | /article/sql-join-in-examples/ |
| Disallow | /cdn-cgi/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ask42.us/sitemap.xml |