en-gage.net
robots.txt
Robots Exclusion Standard data for en-gage.net
Resource Scan
Scan Details
| Site Domain | en-gage.net |
| Base Domain | en-gage.net |
| Scan Status | Ok |
| Last Scan | 2024-09-27T09:42:45+00:00 |
| Next Scan | 2024-10-11T09:42:45+00:00 |
Last Scan
| Scanned | 2024-09-27T09:42:45+00:00 |
| URL | https://en-gage.net/robots.txt |
| Domain IPs | 54.230.71.108, 54.230.71.124, 54.230.71.64, 54.230.71.85 |
| Response IP | 13.227.254.66 |
| Found | Yes |
| Hash | 8ea1e09677091ab6f80121a214aae072fc75a360feea66c2f0ab0a6228e76ebb |
| SimHash | 6b857e042ec2 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /apply/edit/form/ |
| Disallow | /user/apply/ |
| Disallow | /user/signup/*?*work_id= |
| Disallow | */kuchikomi/*?*work_id= |
| Disallow | /user/search$ |
| Disallow | /user/search/$ |
| Disallow | /user/search?*=* |
| Disallow | /user/search/?*=* |
| Disallow | /api/indeed/ |
| Disallow | /api/effect/scout_effect_update/ |
| Disallow | /user/api/auth/login/userid |
| Disallow | /user/api/favorite/work_id_list/ |
| Disallow | /user/api/work_recommend/work_search/ |
| Disallow | /user/api/search/map_work_list/ |
| Disallow | /user/api/search/result_work_list/ |
| Disallow | */user/login/? |
bingbot
| Rule | Path |
|---|---|
| Disallow | /apply/edit/form/ |
| Disallow | /user/apply/ |
| Disallow | /user/signup/*?*work_id= |
| Disallow | */kuchikomi/*?*work_id= |
| Disallow | /user/search$ |
| Disallow | /user/search/$ |
| Disallow | /user/search?*=* |
| Disallow | /user/search/?*=* |
| Disallow | /api/indeed/ |
| Disallow | /api/effect/scout_effect_update/ |
| Disallow | /user/api/auth/login/userid |
| Disallow | /user/api/favorite/work_id_list/ |
| Disallow | /user/api/work_recommend/work_search/ |
| Disallow | /user/api/search/map_work_list/ |
| Disallow | /user/api/search/result_work_list/ |
| Disallow | */user/login/? |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://en-gage.net/sitemap_index.xml |
| sitemap | https://en-gage.net/search2/sitemap_index.xml |