activerain.com
robots.txt
Robots Exclusion Standard data for activerain.com
Resource Scan
Scan Details
| Site Domain | activerain.com |
| Base Domain | activerain.com |
| Scan Status | Ok |
| Last Scan | 2024-10-20T23:29:16+00:00 |
| Next Scan | 2024-11-19T23:29:16+00:00 |
Last Scan
| Scanned | 2024-10-20T23:29:16+00:00 |
| URL | https://activerain.com/robots.txt |
| Domain IPs | 54.69.228.114 |
| Response IP | 54.69.228.114 |
| Found | Yes |
| Hash | b24ff155c3ec3567afad08be763a79361d17364ccba41f303f11167d5eff9ccc |
| SimHash | 027709fd6d75 |
Groups
shopwiki
twiceler
voyager
echrigy
voilabot
baiduspider
yisouspider
petalbot
| Product | Comment |
|---|---|
| twiceler | http://www.cuill.com/twiceler/robot.html |
| voyager | http://www.kosmix.com/html/crawler.html |
| echrigy | http://www.techrigy.com/ |
| voilabot | http://www.voila.fr/ |
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /private_login |
| Disallow | /beta |
| Disallow | /blogs/rss |
| Disallow | /blogs/shorten_url |
| Disallow | /action/blogs/shorten_url |
| Disallow | /blogs/atom |
| Disallow | /blog_entry_comments?sort= |
| Disallow | /likes_list?return_url= |
| Disallow | /action/spellcheck |
| Disallow | /action/blogs_admin |
| Disallow | /action/blogs_admin/subscribe |
| Disallow | /blogindex |
| Disallow | /action/signup/create |
| Disallow | /action/nav/upload_photo |
| Disallow | /action/product_review/thumbs_up |
| Disallow | /action/product_review/thumbs_down |
| Disallow | /realestateandhomes-search |
| Disallow | /action/agents/show_score |
| Disallow | /action/blogs/comments |
| Disallow | /reset_password |
| Disallow | /topbloggers |
| Disallow | /arcaptcha |
| Disallow | /assets/arcaptcha |
| Disallow | /username_autocomplete |
| Disallow | /articles |
| Disallow | /Custom |
| Disallow | /homedetails |
| Disallow | /models |
| Disallow | /photos |
| Disallow | /town-services |
| Disallow | /wiki |
Other Records
| Field | Value |
|---|---|
| sitemap | https://activerain.com/sitemap_index.xml |
Warnings
- 1 invalid line.
Comments