mapdance.com
robots.txt
Robots Exclusion Standard data for mapdance.com
Resource Scan
Scan Details
| Site Domain | mapdance.com |
| Base Domain | mapdance.com |
| Scan Status | Ok |
| Last Scan | 2024-10-24T19:42:31+00:00 |
| Next Scan | 2024-11-23T19:42:31+00:00 |
Last Scan
| Scanned | 2024-10-24T19:42:31+00:00 |
| URL | https://mapdance.com/robots.txt |
| Domain IPs | 163.172.251.8 |
| Response IP | 163.172.251.8 |
| Found | Yes |
| Hash | b43ebd3e48805d2045b9d6b39041f12fd40b15159b3f949518c5b6115abce338 |
| SimHash | 441fef5076ba |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /Me |
| Disallow | /Account |
| Disallow | /fr/Events |
| Disallow | /Events |
| Disallow | /Me/* |
| Disallow | /Account/* |
| Disallow | /fr/Events/* |
| Disallow | /Events/* |
ahrefsbot
ezooms
mj12bot
spbot
| Rule | Path |
|---|---|
| Allow | /$ |
| Disallow | /Find/* |
| Disallow | /*/Find/* |
| Disallow | /Events/* |
| Disallow | /*/Events/* |
| Disallow | /Maps/* |
| Disallow | /*/Maps/* |
| Disallow | /Find/SearchEvents |
| Disallow | /Find/SearchFestivals |
| Disallow | /Find/SearchSchools |
| Disallow | /f |
| Disallow | /e |
| Disallow | /o |
| Disallow | /Me |
| Disallow | /Account |
| Disallow | /fr/Events |
| Disallow | /Events |
| Disallow | /Me/* |
| Disallow | /Account/* |
| Disallow | /fr/Events/* |
| Disallow | /Events/* |
| Disallow | /*/Me |
| Disallow | /*/Account |
| Disallow | /* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
yandexbot
baiduspider
| Rule | Path |
|---|---|
| Disallow | /Me |
| Disallow | /Account |
| Disallow | /fr/Events |
| Disallow | /Events |
| Disallow | /Me/* |
| Disallow | /Account/* |
| Disallow | /fr/Events/* |
| Disallow | /Events/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |