cabincrew.com
robots.txt
Robots Exclusion Standard data for cabincrew.com
Resource Scan
Scan Details
| Site Domain | cabincrew.com |
| Base Domain | cabincrew.com |
| Scan Status | Ok |
| Last Scan | 2024-06-06T19:40:40+00:00 |
| Next Scan | 2024-06-13T19:40:40+00:00 |
Last Scan
| Scanned | 2024-06-06T19:40:40+00:00 |
| URL | https://www.cabincrew.com/robots.txt |
| Redirect | https://www.aviationjobsearch.com/robots.txt |
| Redirect Domain | www.aviationjobsearch.com |
| Redirect Base | aviationjobsearch.com |
| Domain IPs | 104.26.6.121, 104.26.7.121, 172.67.70.59, 2606:4700:20::681a:679, 2606:4700:20::681a:779, 2606:4700:20::ac43:463b |
| Redirect IPs | 104.21.14.34, 172.67.157.175, 2606:4700:3033::ac43:9daf, 2606:4700:3037::6815:e22 |
| Response IP | 104.21.14.34 |
| Found | Yes |
| Hash | 8a77ecd46a8260cfdf22aa83ce299f872c143328ff7dcf6272bb16d85a4442f1 |
| SimHash | 6c1a4c448037 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /__r_frontend_dev.php |
| Disallow | /__r_frontend_dev.php/ |
| Disallow | /apply-job/ |
| Disallow | /recommend-job/ |
| Disallow | /email-job/ |
| Disallow | /job-bookmark/ |
| Disallow | /application-signup-new/ |
| Disallow | /external-application-signup/ |
| Disallow | /qa-post-login/ |
| Disallow | /careers/*/* |
| Disallow | /career-hub/forums/* |
| Disallow | /api/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aviationjobsearch.com/en-GB/sitemap/index.xml |
| sitemap | https://www.aviationjobsearch.com/en-US/sitemap/index.xml |