2015/03/18 - Apache Whirr has been retired.

For more information, please explore the Attic.

Release Notes - Whirr - Version 0.8.2

Bug

  • [WHIRR-677] - Whirr fails to install CDH4 nodemanager properly
  • [WHIRR-678] - Apache Whirr is not using my whirr.location-id parameter on EC2
  • [WHIRR-679] - Switch to HBase 0.94.2
  • [WHIRR-693] - Control order of actions with waves of whirr.instance-templates
  • [WHIRR-705] - provide better integration between parameterized classes and Hiera
  • [WHIRR-707] - RunUrlStatementTest fails due to missing URL
  • [WHIRR-709] - Hadoop defaults fail to install due to version bump @ osuosl.org
  • [WHIRR-712] - prepare_all_disks.sh should cover xvdX as well as sdX.
  • [WHIRR-715] - Unit test failure in whirr-puppet
  • [WHIRR-716] - Karaf itests fail

Improvement

  • [WHIRR-546] - Add destroy instructions to stdout for all create actions
  • [WHIRR-634] - Update private IP host file entry when required by AUTO_HOSTNAME_SUFFIX
  • [WHIRR-660] - provide a useful error message if whirr.instance-templates is not in a cluster spec
  • [WHIRR-661] - Upgrade to Hadoop 1.0.3
  • [WHIRR-669] - The whirr karaf feature should use feature version range on jclouds.
  • [WHIRR-670] - Upgrade to jclouds 1.5.3
  • [WHIRR-672] - Allow eager caching of instance hostname based on pre-provision instance metadata
  • [WHIRR-673] - Upgrade CDH Repos for RHEL/CentOS 6
  • [WHIRR-675] - Convert all whirr.env.* environment variable labels to upper case
  • [WHIRR-681] - enhance puppet service with an ability to export cluster topology to the puppet code
  • [WHIRR-691] - Java install to support Debian
  • [WHIRR-694] - install puppet from puppetlabs repos instead of the ruby gem
  • [WHIRR-699] - Fix indentation and formatting on "Getting Started" page
  • [WHIRR-711] - Add security group support for OpenStack
  • [WHIRR-713] - Enable programmatic use of BYON via CacheNodeStoreModule
  • [WHIRR-717] - Make use of the context name in the dynamic compute cache.

New Feature

  • [WHIRR-118] - Adaptor for OpenStack Clouds
  • [WHIRR-671] - Create Kerberos Service
  • [WHIRR-680] - add python scripts to aid ssh/scp in to VMs
  • [WHIRR-696] - Whirr script for Hadoop MRv2 YARN installs that supports Hadoop-2.0.x and Hadoop 3.x (trunk) branches

Release Notes - Whirr - Version 0.8.1

Bug

  • [WHIRR-641] - No longer possible to hardcode password for bootstrap user
  • [WHIRR-642] - Whirr writes the AWS Secret key to the stdout. is it an unforeseen byproduct or intended behavior?
  • [WHIRR-645] - Race condition between collocated namenode and jobtracker start/init services
  • [WHIRR-646] - Integration tests should have failsafe timeouts
  • [WHIRR-648] - CDH repo install removes other repos with same prefix
  • [WHIRR-666] - Upgrade to jclouds 1.5.1

Improvement

  • [WHIRR-593] - Upgrade to jclouds 1.5.0
  • [WHIRR-638] - Paramaterize OAB Java install
  • [WHIRR-649] - Make install_cdh_hadoop.sh idempotent, fast failing if already run
  • [WHIRR-654] - Tell RAT to avoid checking atlassian-idex.xml
  • [WHIRR-659] - Upgrade to jclouds 1.5.0

Release Notes - Whirr - Version 0.8.0

Sub-task

  • [WHIRR-421] - Handle more role / service lifecycle events as part of the core functionality
  • [WHIRR-422] - Integration tests should fail or succeed in a limited amount of time

Bug

  • [WHIRR-378] - Auth fail when creating a cluster from an EC2 instance
  • [WHIRR-435] - sun-java6-jdk installation fails in install_java_deb() function on Ubuntu 11.10 AMI
  • [WHIRR-438] - Add new amazon west region
  • [WHIRR-445] - JAVA_HOME is not set / exported by the install script
  • [WHIRR-473] - HadoopServiceController.getInstance(String config) does not update instances correctly
  • [WHIRR-494] - Update the BYON cluster controller to support all the operations the regular controller supports
  • [WHIRR-496] - Documentation in 5-Minute guide is missing key option for destroy step
  • [WHIRR-511] - Instance.getPrivateHostName returns an IP address
  • [WHIRR-524] - Change confusing 'Starting cluster' message
  • [WHIRR-536] - Using SNAPSHOT versions of jclouds breaks OSGi support
  • [WHIRR-541] - install_oracle_jdk[67].sh fails to create /usr/bin/java
  • [WHIRR-549] - Remove dependency on system SSH keys in tests
  • [WHIRR-568] - Use the correct CDH version/repository
  • [WHIRR-579] - sun jdk install fails
  • [WHIRR-580] - install_openjdk_rpm is broken
  • [WHIRR-582] - Yarn service does not build in IntelliJ because of missing Hadoop test dependencies
  • [WHIRR-583] - Install OpenJDK fails on centos
  • [WHIRR-584] - Change confusing ssh login help message at the end of deployment
  • [WHIRR-588] - Timeouts on whirr run-script command
  • [WHIRR-599] - Whirr CDH4 CDHHadoopServiceTest.testVersion() is broken
  • [WHIRR-600] - Bump up CDH4 Maven dependencies
  • [WHIRR-601] - Cassandra 1.0.8 download URL no longer valid
  • [WHIRR-602] - Cloud providers may only return "private" IPs
  • [WHIRR-603] - HBase 0.89 tests won't work with Hadoop 0.20.205
  • [WHIRR-604] - Non-resolvable hostnames should be reset to something resolvable
  • [WHIRR-608] - CDH HBase configuration uses CDH3 package and service names only
  • [WHIRR-609] - Yum install of openjdk needs -y
  • [WHIRR-610] - whirr.env.repo should be whirr.env.REPO (?)
  • [WHIRR-611] - Cloud providers may only return "public" IPs
  • [WHIRR-612] - CDH4 can be installed on Ubuntu now as well as CentOS
  • [WHIRR-613] - OpenJDK JAVA_HOME detection needs to be improved
  • [WHIRR-614] - Add HADOOP_HOME/lib to HBase classpath
  • [WHIRR-615] - Use Hadoop 1.0.3 in HBase 0.90 tests
  • [WHIRR-616] - Starting multiple yarn nodemanagers on EC2
  • [WHIRR-618] - Site generation is unnecessarily recursive
  • [WHIRR-629] - YARN tests fail on Rackspace
  • [WHIRR-633] - Align jclouds 1.5.0 modularity changes with Whirr
  • [WHIRR-635] - Ensure hostname update as required by AUTO_HOSTNAME_SUFFIX is consistent for RHEL derivatives
  • [WHIRR-639] - /data*/hadoop should be owned and writable by the hadoop group for CDH.
  • [WHIRR-640] - Recipes and tests using whirr.template should specify minRam there

Improvement

  • [WHIRR-189] - Hadoop on EC2 should use all available local storage
  • [WHIRR-332] - Need to specify different instance size/type depending on role
  • [WHIRR-347] - Support provider-independent environment variables for cloud credentials
  • [WHIRR-351] - configure_hadoop should create+chown all data dirs listed in hadoop-hdfs.dfs.data.dir
  • [WHIRR-370] - Templating for configuration files
  • [WHIRR-428] - Always match a stable Canonical AMI on AWS EC2
  • [WHIRR-436] - Allow Whirr to run from inside OSGi
  • [WHIRR-456] - Upgrade to jclouds 1.3.0
  • [WHIRR-458] - Remove deprecated code and aliasing mechanism
  • [WHIRR-461] - Allow user to specify spot instance price per instance template group
  • [WHIRR-469] - Optimal Cassandra Node Balancing
  • [WHIRR-471] - Display jclouds version
  • [WHIRR-474] - Add functions that can be used as basic distributed synchronisation primitives in bash scripts
  • [WHIRR-475] - Rename login-user to bootstrap-user to avoid confusions
  • [WHIRR-479] - ScriptBasedClusterAction should allow filtering by role and instance-id
  • [WHIRR-483] - Upgrade to jclouds 1.3.1
  • [WHIRR-484] - Add restart-services command
  • [WHIRR-497] - Update maven plugins & project deps
  • [WHIRR-504] - Upgrade to jclouds 1.4.0
  • [WHIRR-509] - Provide live OSGi integration tests
  • [WHIRR-510] - Get ZooKeeper ensemble with internal addresses
  • [WHIRR-525] - Upgrade to HBase 0.92.0
  • [WHIRR-528] - Add a retry loop around apt-get and yum commands to overcome transient errors
  • [WHIRR-542] - Only expose start / stop / restart as new CLI commands
  • [WHIRR-548] - Allow whirr to reuse existing compute services
  • [WHIRR-551] - Upgrade to jclouds 1.3.2
  • [WHIRR-556] - The message 'running on $PROVIDER using identity $IDENTITY' is confusing
  • [WHIRR-561] - Make HBase metrics appear in Ganglia
  • [WHIRR-573] - Allow specification of REPO_HOST for RPMs/debs
  • [WHIRR-587] - Update version of jopt-simple (from 3.2 to 4.3)
  • [WHIRR-591] - Maven profile for Karaf itests (inactive by default)
  • [WHIRR-605] - Upgrade Cassandra to 1.1.2
  • [WHIRR-630] - add property endpoint
  • [WHIRR-665] - list of SSH commands should also identify host roles

New Feature

  • [WHIRR-63] - Support EC2 Cluster Compute Groups for Hadoop
  • [WHIRR-388] - Support for CloudStack
  • [WHIRR-465] - Add Solr as a service
  • [WHIRR-500] - Let users control which hardware is used for each instance template.

Task

  • [WHIRR-477] - Upgrade Cassandra service to 1.0.7
  • [WHIRR-514] - Update release instructions or fix update-version script?

Test

  • [WHIRR-493] - Test override number of mappers for Hadoop

Release Notes - Whirr - Version 0.7.1

Bug

  • [WHIRR-367] - Wrong groupId for zookeeper
  • [WHIRR-460] - Error while running whirr on Cygwin
  • [WHIRR-490] - hadoop-mapreduce.mapred.child.ulimit should be unlimited by default
  • [WHIRR-495] - bin/whirr is does not have executable permissions in the 0.7.0 pre-built download
  • [WHIRR-502] - configure_cdh_hadoop.sh: syntax error trying to modify permissions on $HADOOP_LOG_DIR
  • [WHIRR-518] - Change to OpenJDK
  • [WHIRR-520] - Using OAB script to install sun jdk
  • [WHIRR-521] - Backport InstallJDK functionality from jclouds 1.4.0

Improvement

  • [WHIRR-439] - Make proxy files executable
  • [WHIRR-454] - Allow openjdk to be installed as an alternative to sun-java-6
  • [WHIRR-463] - Fail fast when running as root
  • [WHIRR-498] - Update the list of known limitations
  • [WHIRR-507] - Make whirr script executable from any path
  • [WHIRR-517] - Add a retry loop around apt-get and yum commands to overcome transient errors
  • [WHIRR-526] - Don't log harmless sshj errors to console

Release Notes - Whirr - Version 0.7.0

Sub-task

Bug

  • [WHIRR-352] - mvn package assembly:assembly fails
  • [WHIRR-376] - Launching a BYON cluster doesn't produce an instances file.
  • [WHIRR-377] - Fix broken CLI logging config
  • [WHIRR-394] - NPE used for flow control
  • [WHIRR-396] - service/ganglia needs non-zero send_metadata_interval= in gmond.conf
  • [WHIRR-397] - Automatic template selection is too restrictive
  • [WHIRR-410] - Review automatic image selection
  • [WHIRR-412] - cannot set up eclipse at "How To Contribute"
  • [WHIRR-414] - whirr can have a non-zero return code and unterminated (orphaned) host instances
  • [WHIRR-427] - CDH Hadoop integration test fails with malformed reply from SOCKS, may be version issue
  • [WHIRR-432] - Puppet integration tests failing
  • [WHIRR-433] - Chef integration tests failing
  • [WHIRR-437] - Cassandra integration test is failing
  • [WHIRR-442] - release 0.6.0 is in breach of the AL2.0 and general Apache rules in regards to the inclusion of Voldemort
  • [WHIRR-447] - FastDnsResolver fails with SocketTimeoutException
  • [WHIRR-449] - slf4j impl is not being copied to the lib dir when executing the binary assembly

Improvement

  • [WHIRR-116] - Site should have docs for each released version
  • [WHIRR-243] - Allow to run component tests in memory
  • [WHIRR-325] - Reduce cloud provider-specific code in scripts
  • [WHIRR-340] - Use spot instances for testing
  • [WHIRR-342] - hadoop/hbase configuration & active roles on a node
  • [WHIRR-356] - Upgrade elasticsearch to 0.17.4
  • [WHIRR-357] - Run elasticsearch as a non-root-user
  • [WHIRR-358] - Enable remote JMX access for HBase
  • [WHIRR-366] - Make website comply with Apache branding guidelines
  • [WHIRR-368] - Add the ability to adjust contents of hadoop-env.sh from a cluster properties file
  • [WHIRR-371] - Allow defining additional firewall rules
  • [WHIRR-382] - Upgrade to Commons Configuration 1.7
  • [WHIRR-395] - Less verbose logging when setting firewall rules
  • [WHIRR-399] - Move common script setup and script execution fork/join outside of ConfigureClusterAction and DestroyClusterAction
  • [WHIRR-400] - Upgrade to jclouds 1.2.1
  • [WHIRR-401] - Use regular instances for testing on aws-ec2
  • [WHIRR-402] - Remove SaveHttpResponseTo and use the class provided by jclouds
  • [WHIRR-408] - Upgrade elasticsearch to 0.18.2.
  • [WHIRR-411] - put install_git, install_ruby scripts in core
  • [WHIRR-415] - Let users specify the CDH release (cdh3u1, cdh3u2)
  • [WHIRR-416] - Enable lazy image fetching when the image-id is known
  • [WHIRR-417] - Allow users to choose their own jclouds modules with properties
  • [WHIRR-418] - add ssh debug logs to tests
  • [WHIRR-419] - Display how to connect to remote machines
  • [WHIRR-420] - Document jclouds specific configuration options
  • [WHIRR-423] - Refactor StartupProcess.cleanupFailedNodes
  • [WHIRR-426] - Create a convention for naming clusters used for integration tests
  • [WHIRR-440] - Unit tests improvements (less bound to external services)
  • [WHIRR-446] - Upgrade all maven plugins to latest stable release

New Feature

  • [WHIRR-49] - Allow Whirr to use Chef for configuration management
  • [WHIRR-258] - Add Ganglia as a service
  • [WHIRR-384] - Add Mahout as a service
  • [WHIRR-385] - Implement support for using nodeless, masterless Puppet to provision and run scripts
  • [WHIRR-398] - Implement the execution of scripts on DestroyClusterAction

Test

  • [WHIRR-409] - Add an integration test that shows that there is no overlap between install & configure scripts on the remote machine

Wish

  • [WHIRR-405] - Read PMC Branding Responsibilities

Release Notes - Whirr™ - Version 0.6.0

Sub-task

  • [WHIRR-341] - Improve automatic OS image selection

Bug

  • [WHIRR-249] - Firewall authorization should be idempotent
  • [WHIRR-315] - Temporary override Providers#withIds until jclouds beta-10 is out
  • [WHIRR-330] - BYON doesn't work with HadoopConfigurationBuilder
  • [WHIRR-334] - Support for CDH3u0 HBase
  • [WHIRR-363] - ComputeCache redundantly creates ComputeServiceContexts
  • [WHIRR-364] - [voldemort] 0.90.RC3 build artifact no longer available
  • [WHIRR-365] - Too verbose command line interface logging

Improvement

  • [WHIRR-28] - Add examples module
  • [WHIRR-311] - Allow services to register new CLI commands
  • [WHIRR-319] - Run rat & checkstyle before packaging
  • [WHIRR-320] - Convert site documentation to xdoc format
  • [WHIRR-323] - Allow user to specify a blobstore container to be used for caching local files
  • [WHIRR-327] - Upgrade to jclouds 1.0.0
  • [WHIRR-331] - Add the ability to specify tarball URLs that are local to the remote machine
  • [WHIRR-338] - byon cluster with hostnames defined in /etc/hosts
  • [WHIRR-339] - Allow to specify hbase-site.xml properties through cluster configuration file
  • [WHIRR-345] - Add Hama service information to the website
  • [WHIRR-349] - Retry if blobstore put fails
  • [WHIRR-350] - Update Hama service to 0.3 version
  • [WHIRR-354] - Upgrade to jclouds 1.1.0
  • [WHIRR-359] - Document known limitations for Whirr 0.6.0
  • [WHIRR-361] - refactor jclouds dependencies
  • [WHIRR-362] - BlobStore contexts are redundantly created

New Feature

  • [WHIRR-76] - Support spot instances in python scripts
  • [WHIRR-240] - [HBase] Enable support for HBase 0.90.x
  • [WHIRR-260] - Support Spot Instances
  • [WHIRR-313] - Add Hama as a Service
  • [WHIRR-326] - Use jclouds provider metadata to help with cloud provider configuration

Wish

  • [WHIRR-257] - Remove outdated Python contrib

Release Notes - Whirr - Version 0.5.0

Sub-task

  • [WHIRR-277] - Support multiple versions of ZooKeeper
  • [WHIRR-279] - Create ClusterSpec aware BlobStoreContext factory class
  • [WHIRR-280] - Create a blob cache that could be used for storing local files
  • [WHIRR-292] - Separate Cassandra install and configuration scripts into more generic functions
  • [WHIRR-296] - Separate Voldemort install and configuration scripts into more generic functions
  • [WHIRR-297] - Separate ZooKeeper and ElasticSearch install and configuration scripts into more generic functions

Bug

  • [WHIRR-172] - Log warning for unrecognized service names
  • [WHIRR-253] - ZooKeeper service should only authorize ingress to ZooKeeper instances
  • [WHIRR-268] - whirr hangs when the file '$HOME/.ssh/known_hosts' includes an obsolete identifier for a certain ip address host.
  • [WHIRR-271] - Classpath needs to be quoted in whirr script
  • [WHIRR-274] - Add wagon-ssh-external as a maven build extension
  • [WHIRR-298] - Use all cluster spec properties for hash and equality
  • [WHIRR-312] - Destroy instance removes all entries from the instances file except the one that is being terminated
  • [WHIRR-314] - HBase integration test can fail due to Thrift server race

Improvement

  • [WHIRR-61] - make more efficient use of ComputeServiceContext
  • [WHIRR-173] - Add ClusterAction for generic script execution
  • [WHIRR-216] - Improve error message if whirr.instance-templates left out of config
  • [WHIRR-222] - Support multiple versions of Hadoop
  • [WHIRR-236] - Update Configuration Guides with Recipe Info
  • [WHIRR-245] - Clearly demarcate the user and service provider APIs
  • [WHIRR-246] - Single place to store/load cluster state
  • [WHIRR-262] - Services should not have to do reverse DNS lookups
  • [WHIRR-269] - improve error msg "Key pair is encrypted"
  • [WHIRR-275] - Improve firewall API for services
  • [WHIRR-278] - Refactor ClusterSpec and extract InstanceTemplate class
  • [WHIRR-282] - Set number of Hadoop slots based on hardware
  • [WHIRR-283] - Whirr in 5 minutes
  • [WHIRR-284] - Runurl should only be installed when needed
  • [WHIRR-288] - Add blob store persistence for cluster state
  • [WHIRR-289] - Display role names in list-cluster command
  • [WHIRR-291] - Add "noop" role useful just for provisioning
  • [WHIRR-299] - Recipe for BYON provider
  • [WHIRR-300] - FAQ entry for noop role
  • [WHIRR-304] - Upgrade to jclouds 1.0-beta-9c
  • [WHIRR-310] - Improve Configuration Guide

New Feature

  • [WHIRR-191] - [CDH] Start other services based on CDH, not just HDFS and MR
  • [WHIRR-220] - Support local tarball upload
  • [WHIRR-237] - Add Voldemort as a service
  • [WHIRR-261] - Add ElasticSearch as a service
  • [WHIRR-285] - Add support for BYON

Task

Test

  • [WHIRR-287] - Script for running YCSB on HBase

Release Notes - Whirr - Version 0.4.0

Sub-task

  • [WHIRR-139] - upgrade to version 1 of the "enforcer" plugin

Bug

  • [WHIRR-170] - Instances should be started in the order specified in the template
  • [WHIRR-201] - [HBase] Integration test fails
  • [WHIRR-207] - Handle curl timeouts better
  • [WHIRR-217] - Log files should not be included in tarball or checked by RAT
  • [WHIRR-227] - CDH and Hadoop integration tests are failing
  • [WHIRR-232] - NPE for stopped instances on EC2
  • [WHIRR-234] - Resource functions/install_cdh_hadoop.sh not found when running from the CLI
  • [WHIRR-235] - fix whirr.provider in recipes/*
  • [WHIRR-241] - Update to use CDH3B4
  • [WHIRR-247] - Add license headers to service install and configure scripts
  • [WHIRR-250] - Ensure all libraries in binary distribution have associated licenses where stipulated
  • [WHIRR-251] - Handle Apache cryptography requirements for release
  • [WHIRR-263] - Default tarball not found for Cassandra (broken link in install_cassandra.sh)
  • [WHIRR-264] - JClouds is unable to do SSH on automatically selected images
  • [WHIRR-267] - Update NOTICE and LICENSE files to mention 3rd party products

Improvement

  • [WHIRR-55] - Users should be able to override an arbitrary Hadoop property before launch
  • [WHIRR-124] - Upgrade to jclouds 1.0-beta-9
  • [WHIRR-167] - Improve bootstrapping and configuration to be able to isolate and repair or evict failing nodes on EC2
  • [WHIRR-183] - ZooKeeper Data Directory Cleanup
  • [WHIRR-186] - [HBase] Add version support configurable in properties file
  • [WHIRR-193] - Recipe for a HBase Cluster
  • [WHIRR-195] - Display available roles instead of service names when running ./bin/whirr
  • [WHIRR-199] - Add aliases for short role names like nn, jt, tt, dn, zk
  • [WHIRR-215] - Add builder pattern to addRunUrl() call
  • [WHIRR-219] - Support dynamic addition of services to CLI
  • [WHIRR-231] - Update documentation after upgrade to jclouds 1.0-beta-9
  • [WHIRR-233] - Change test properties to be less provider bound and improve TemplateBuilder defaults
  • [WHIRR-242] - Update documentation for overriding locally supplied scripts
  • [WHIRR-244] - Add package-level javadoc
  • [WHIRR-254] - Document limitation that a role may only appear in one instance template group
  • [WHIRR-259] - Disable configuration list handling for Hadoop properties
  • [WHIRR-265] - Missing SVN EOL properties

New Feature

  • [WHIRR-158] - Allow users to log into clusters as themselves
  • [WHIRR-198] - support user-defined images
  • [WHIRR-225] - Support locally-supplied scripts
  • [WHIRR-226] - Add the ability to destroy a cluster instance

Task

  • [WHIRR-129] - Add Adrian Cole as a committer in the whirr pom.xml and site.
  • [WHIRR-248] - Update to jclouds-1.0-beta9b

Release Notes - Whirr - Version 0.3.0

Bug

  • [WHIRR-123] - Cassandra integration tests hang if whirr's scripts bucket is missing
  • [WHIRR-127] - binary assembly from WHIRR-100 is not generated as part of release process
  • [WHIRR-128] - In ec2 instances instead of public dns names a public ip address is resolved for the started master node which causes workers to not be able to connect back to the master
  • [WHIRR-137] - Allow use of an arbitrary AMI on EC2
  • [WHIRR-146] - Changing the mapred.child.java.opts value does not change the heap size from a default one.
  • [WHIRR-147] - Regression on launching clusters from EC2
  • [WHIRR-151] - Credentials not set correctly for Hadoop service configure step
  • [WHIRR-156] - Cli script doesn't launch post-modularization
  • [WHIRR-159] - Cassandra and ZooKeeper fail on Ubuntu on Rackspace
  • [WHIRR-162] - DnsUtilTest fails when offline or for slow connections
  • [WHIRR-164] - Tests fail if there is no ~/.ssh/id_rsa keypair
  • [WHIRR-165] - Hadoop integration tests fail due to WHIRR-160 changes
  • [WHIRR-175] - ZooKeeper service does not honor instance roles
  • [WHIRR-179] - [Hadoop] Guard $MOUNT/tmp mkdir call against existing directory
  • [WHIRR-180] - ListClusterCommand.run throws a NullPointerException for unrecognized service names
  • [WHIRR-185] - [ZooKeeper] Fix selection of instances for getHosts() call
  • [WHIRR-200] - Cassandra integration test hangs
  • [WHIRR-201] - HBase integration test fails
  • [WHIRR-204] - CDH Hadoop integration test fails on Rackspace
  • [WHIRR-205] - Override service.provider for integration tests
  • [WHIRR-209] - bin/whirr fails on a new release
  • [WHIRR-210] - Remove unneeded dependent libraries
  • [WHIRR-211] - Fix checkstyle errors for 0.3.0

Improvement

  • [WHIRR-87] - Parallelize Hadoop cluster creation
  • [WHIRR-115] - Distribution should include documentation
  • [WHIRR-140] - include KEYS file in release artifact.
  • [WHIRR-145] - Add Whirr recipes for common configurations
  • [WHIRR-150] - Allow retrieval of instance roles
  • [WHIRR-153] - Add documentation for WHIRR-87 (Parallelize Hadoop cluster creation)
  • [WHIRR-154] - cassandra: expose RPC port, as well
  • [WHIRR-155] - Support multiple versions of Cassandra
  • [WHIRR-157] - Remove service name property
  • [WHIRR-160] - Improve SSH key diagnostics
  • [WHIRR-161] - Check that both SSH keys belong to the same pair
  • [WHIRR-163] - Support environment variable interpolation in configuration properties
  • [WHIRR-166] - Improve docs regarding private keys
  • [WHIRR-174] - Fix ZooKeeper to allow stand-alone mode setups
  • [WHIRR-178] - [Hadoop] Guard useradd against existing user account
  • [WHIRR-181] - Add descriptions for CLI command options
  • [WHIRR-187] - [HBase] Change hbase.tmp.dir to be in line with Hadoop service
  • [WHIRR-190] - Create /tmp in HDFS for Pig
  • [WHIRR-194] - Update the list of supported services on the home page
  • [WHIRR-202] - Improve instance template syntax checking
  • [WHIRR-203] - General documentation improvements for 0.3.0
  • [WHIRR-206] - [HBase] Extract strings to a HBaseServiceConstants interface

New Feature

  • [WHIRR-25] - Add HBase service
  • [WHIRR-117] - Composable services
  • [WHIRR-176] - Set AWS credentials in the local site file for Hadoop S3 access

Task

  • [WHIRR-196] - Ensure integration tests pass on all supported providers

Test

  • [WHIRR-92] - Add a benchmark for Hadoop clusters

Release Notes - Whirr - Version 0.2.0

Bug

  • [WHIRR-91] - Add DISCLAIMER file to CLI JAR
  • [WHIRR-93] - Fail on checkstyle violation
  • [WHIRR-97] - Lucid is not stable on EC2
  • [WHIRR-101] - Hadoop on EC2 does not use the /mnt partition
  • [WHIRR-102] - unknown service NPEs cli, should print the bad service to console
  • [WHIRR-106] - improve logging in whirr cli
  • [WHIRR-107] - Test failing due to not matching Amazon Linux AMI on EC2
  • [WHIRR-108] - Fix checkstyle and rat violations
  • [WHIRR-113] - Hadoop cluster instances should all start in the same location
  • [WHIRR-114] - Support + character in version number
  • [WHIRR-122] - whirr site has two FAQ links
  • [WHIRR-126] - Deployment process does not deploy required test JARs

Improvement

  • [WHIRR-52] - Allow a Hadoop MapReduce job to be run against a Hadoop Service running on Rackspace Cloud Servers
  • [WHIRR-66] - Upgrade to jclouds 1.0-beta-7
  • [WHIRR-89] - Support maven 3 builds
  • [WHIRR-90] - Scripts should be versioned
  • [WHIRR-103] - add more to .gitignore
  • [WHIRR-104] - print available services in cli help string
  • [WHIRR-105] - Add version command to the CLI
  • [WHIRR-109] - Unit tests fail if there is no private key found at ~/.ssh/id_rsa
  • [WHIRR-110] - Create client-side Hadoop configuration file during cluster launch
  • [WHIRR-112] - Expand documentation

New Feature

  • [WHIRR-73] - Add a list command to the CLI
  • [WHIRR-100] - Create a binary distribution of Whirr

Release Notes - Whirr - Version 0.1.0

Sub-task

  • [WHIRR-40] - fill in getting started documentation - getting-started.confluence
  • [WHIRR-77] - Document and implement release process
  • [WHIRR-78] - Add KEYS file to distribution directory
  • [WHIRR-85] - Publish Maven artifacts to http://repository.apache.org
  • [WHIRR-86] - Update quick start documentation to work with release 0.1.0

Bug

  • [WHIRR-4] - hadoop-cloud push command invokes proxy creation
  • [WHIRR-37] - Don't require manual installation of Apache RAT to compile
  • [WHIRR-48] - Fix RAT warnings due to site files
  • [WHIRR-50] - Cassandra POM should depend on top-level
  • [WHIRR-65] - Workaround bug 331 in jclouds (Some EC2ComputeService operations fail for stopped instances)
  • [WHIRR-71] - Only allow access to clusters from defined networks
  • [WHIRR-79] - Hadoop service is broken
  • [WHIRR-82] - Integration tests should not run on "mvn install"
  • [WHIRR-84] - Log4j is missing from the CLI JAR

Improvement

  • [WHIRR-8] - Create ant build for running EC2 unit tests
  • [WHIRR-9] - Support additional security group option in hadoop-ec2 script
  • [WHIRR-10] - Create setup.py for EC2 cloud scripts
  • [WHIRR-20] - Generate RAT report
  • [WHIRR-21] - Enforce source code style
  • [WHIRR-22] - Separate unit and integration (system) tests
  • [WHIRR-23] - Upgrade to jclouds 1.0-beta-6
  • [WHIRR-26] - Allow script locations to be overridden
  • [WHIRR-31] - Add Whirr quick start to README.txt and website (once it's live)
  • [WHIRR-32] - Update POM to point to Apache RAT 0.8-SNAPSHOT
  • [WHIRR-34] - Open up ports 50010 (JobTracker) and 50070 (NameNode) for the Hadoop Service
  • [WHIRR-38] - Add core javadoc
  • [WHIRR-47] - Create a Service factory
  • [WHIRR-51] - Allow the Hadoop service to be run on Rackspace Cloud servers
  • [WHIRR-53] - Adopt the standard Java SPI interface
  • [WHIRR-54] - Implement service/cdh
  • [WHIRR-58] - introduce naming consistency for cloud service providers
  • [WHIRR-64] - Unify ClusterSpec and ServiceSpec
  • [WHIRR-70] - decouple keypairs from the files that hold them
  • [WHIRR-75] - Use Commons Configuration to manage cluster specs
  • [WHIRR-80] - Clean up POM dependencies

New Feature

  • [WHIRR-3] - Add support for EBS storage on EC2
  • [WHIRR-5] - Run namenode and jobtracker on separate EC2 instances
  • [WHIRR-6] - Write a Rackspace cloud provider
  • [WHIRR-7] - Add a ZooKeeper service to the cloud scripts
  • [WHIRR-27] - Add Cassandra service
  • [WHIRR-33] - Add a CLI

Task

  • [WHIRR-1] - Import initial source code from Hadoop contrib
  • [WHIRR-2] - Import initial Java source code
  • [WHIRR-19] - Create project website
  • [WHIRR-29] - Add target directories to svn ignore
  • [WHIRR-46] - Release version 0.1.0