friends.myspace.com
robots.txt
Robots Exclusion Standard data for friends.myspace.com
Resource Scan
Scan Details
Site Domain | friends.myspace.com |
Base Domain | myspace.com |
Scan Status | Ok |
Last Scan | 2024-10-15T21:06:12+00:00 |
Next Scan | 2024-11-14T21:06:12+00:00 |
Last Scan
Scanned | 2024-10-15T21:06:12+00:00 |
URL | https://friends.myspace.com/robots.txt |
Redirect | https://myspace.com/robots.txt |
Redirect Domain | myspace.com |
Redirect Base | myspace.com |
Domain IPs | 34.111.176.156 |
Redirect IPs | 34.111.176.156 |
Response IP | 34.111.176.156 |
Found | Yes |
Hash | 9e0c859a675640d4754cb878ee4b6e2c78d670162bc58cbfc2142b913d896f50 |
SimHash | 298c28acced0 |
Groups
*
Rule | Path |
---|---|
Disallow | /settings/* |
Disallow | /manage/* |
Disallow | /signup/* |
Disallow | /thirdpartyimport/* |
Disallow | /insights/* |
Disallow | /search/* |
Disallow | /help/* |
Disallow | /auth/* |
Disallow | /library/* |
Disallow | /pages/legal* |
Disallow | /examples/* |
Disallow | /tests/* |
Disallow | /notifications/* |
Disallow | /messages/* |
Disallow | /ajax/* |
Disallow | /*/ajax/* |
Disallow | /home |
Disallow | /signout |
Disallow | /profilerole |
Disallow | /profilesetup |
Disallow | /redirector |
Disallow | /history |
Disallow | /queue |
Disallow | /notifications |
Disallow | /messages |
Disallow | /reportabuse |
Disallow | /pages/privacy |
Disallow | /pages/terms |
Disallow | /version |
Disallow | /build |
Disallow | /*/connections/* |
Disallow | /*/topfans |
Disallow | /*/events |
Disallow | /beacon |
Disallow | /music/song-embed |
Disallow | /post |
Disallow | /modules/postto/pages |
Disallow | /connections/recent |
Other Records
Field | Value |
---|---|
sitemap | https://myspace.com/sitemap.xml |
sitemap | https://myspace.com/artist_sitemap.xml |
sitemap | https://myspace.com/editorial_news_sitemap.xml |
sitemap | https://myspace.com/editorial_sitemap.xml |
sitemap | https://myspace.com/editorial_rss.xml |
sitemap | https://myspace.com/video_sitemap_1.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type1_2.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type1_3.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type1_4.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type1_5.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type1_6.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type1_7.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type1_8.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type1_9.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type2_1.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type2_2.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type2_3.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type2_4.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type2_5.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type2_6.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type2_7.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type2_8.xml |
sitemap | http://sitemaps.myspace.com/VideoSitemap/sitemap_index_type2_9.xml |