getgigs.co
robots.txt
Robots Exclusion Standard data for getgigs.co
Resource Scan
Scan Details
| Site Domain | getgigs.co |
| Base Domain | getgigs.co |
| Scan Status | Ok |
| Last Scan | 2024-10-14T23:11:11+00:00 |
| Next Scan | 2024-11-13T23:11:11+00:00 |
Last Scan
| Scanned | 2024-10-14T23:11:11+00:00 |
| URL | https://getgigs.co/robots.txt |
| Domain IPs | 13.227.254.117, 13.227.254.24, 13.227.254.79, 13.227.254.95 |
| Response IP | 13.227.254.24 |
| Found | Yes |
| Hash | ec0b7f63e1d4ae5b7002ddf3df93f6c5e275b34636464741a91ad2f9cb2905fe |
| SimHash | 20a55042a136 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sign-in |
| Disallow | /sign-up |
anthropic-ai
| Rule | Path |
|---|---|
| Disallow | /locations/ |
| Disallow | /jobs/ |
| Disallow | /search* |
| Disallow | /*-jobs* |
| Disallow | /jobs-in-* |
ccbot
| Rule | Path |
|---|---|
| Disallow | /locations/ |
| Disallow | /jobs/ |
| Disallow | /search* |
| Disallow | /*-jobs* |
| Disallow | /jobs-in-* |
facebookbot
| Rule | Path |
|---|---|
| Disallow | /locations/ |
| Disallow | /jobs/ |
| Disallow | /search* |
| Disallow | /*-jobs* |
| Disallow | /jobs-in-* |
google-extended
| Rule | Path |
|---|---|
| Disallow | /locations/ |
| Disallow | /jobs/ |
| Disallow | /search* |
| Disallow | /*-jobs* |
| Disallow | /jobs-in-* |
gptbot
| Rule | Path |
|---|---|
| Disallow | /locations/ |
| Disallow | /jobs/ |
| Disallow | /search* |
| Disallow | /*-jobs* |
| Disallow | /jobs-in-* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://getgigs.co/sitemap-index.xml |