massvacation.com
robots.txt
Robots Exclusion Standard data for massvacation.com
Resource Scan
Scan Details
Site Domain | massvacation.com |
Base Domain | massvacation.com |
Scan Status | Ok |
Last Scan | 2024-06-22T18:55:34+00:00 |
Next Scan | 2024-07-22T18:55:34+00:00 |
Last Scan
Scanned | 2024-06-22T18:55:34+00:00 |
URL | https://massvacation.com/robots.txt |
Redirect | https://www.visitma.com/robots.txt |
Redirect Domain | www.visitma.com |
Redirect Base | visitma.com |
Domain IPs | 23.185.0.2, 2620:12a:8000::2, 2620:12a:8001::2 |
Redirect IPs | 104.26.8.71, 104.26.9.71, 172.67.74.198, 2606:4700:20::681a:847, 2606:4700:20::681a:947, 2606:4700:20::ac43:4ac6 |
Response IP | 104.26.9.71 |
Found | Yes |
Hash | 19986657ad84b511f9d25ee220cc55d09f04649de21469a933e3afca1665b1b1 |
SimHash | 821579744b31 |
Groups
mozilla/5.0 applewebkit/537.36 (khtml, like gecko; compatible; claudebot/1.0; +claudebot@anthropic.com)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (macintosh; intel mac os x 10_10_1) applewebkit/600.2.5 (khtml, like gecko) version/8.0.2 safari/600.2.5 (amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 applewebkit/537.36 (khtml, like gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) chrome/116.0.1938.76 safari/537.36
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (macintosh; intel mac os x 10_15_7) applewebkit/537.36 (khtml, like gecko) chrome/114.0.0.0 safari/537.36
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (linux; android 6.0.1; nexus 5x build/mmb29p) applewebkit/537.36 (khtml, like gecko) chrome/122.0.6261.94 mobile safari/537.36 (compatible; googlebot/2.1; +http://www.google.com/bot.html)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (iphone; cpu iphone os 6_0 like mac os x) applewebkit/536.26 (khtml, like gecko) version/6.0 mobile/10a5376e safari/8536.25 (compatible; siteauditbot/0.97; +http://www.semrush.com/bot.html)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (windows nt 10.0; win64; x64) applewebkit/537.36 (khtml, like gecko) chrome/78.0.3904.97 safari/537.36 (+https://www.loc.gov/programs/web-archiving/for-site-owners/)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (linux; android 5.0) applewebkit/537.36 (khtml, like gecko) mobile safari/537.36 (compatible; bytespider; spider-feedback@bytedance.com)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (linux; android 13) applewebkit/537.36 (khtml, like gecko) chrome/108.0.5359.128 mobile safari/537.36 (compatible; ahrefssiteaudit/6.1; +http://ahrefs.com/robot/site-audit)
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |