Agility has become the buzz word around the enterprise. whether it is agility around storage, networking, cloud operations, or most any other IT service is not really the point here, it all comes down to agility as an ideology.
Take for example the burgeoning data analytics market, which is driven by big data and business intelligence, where implementing agile ideologies could be the secret to success. After all, an agile business needs to be able to react to trends and discoveries to remain competitive, and waiting on analytics does not bode well for those looking to make intelligent decisions as quickly as possible.
In other words, best of breed analytics solutions must bridge the gap between data science and production to unify development and deployment into an agile methodology. With that in mind, Florian Douetteau, CEO of Dataiku, has put together an interesting guidebook that discusses how to achieve that level of synergy to build a data project that embodies the ideologies of agility.
Douetteau has identified the key strategies that illustrate how to bring agility to a data science project, those strategies include adopting:
– Consistent Packaging and Release
– Continuous Retraining of Models
– Multivariate Optimization
– Functional Monitoring
– Roll-Back Strategy
– IT Environment Consistency
– Failover Strategies
– Auditability and Version Control
– Performance and Scalability
Ultimately, the goal here is to bring agility to the data team, where a data science team and IT production can work hand in hand to deliver results in an agile fashion.
In an Interview with GigaOM, Douetteau offered additional advice, he said “One of the most valuable tips I can offer is that IT should provide a common platform, which gives users across the different groups access to the tools and technologies they are familiar with. Ideally, visual drag and drop tools for should be provided for less technical team members, while the ability to code, should be provided for advanced members. What’s more, monitoring, security options and role based administration tools should be made available to those responsible of deployments.”
Nonetheless, previous attempts to achieve the goal of agile decision making has been an almost impossible task, thanks to the silos surrounding data science development and the deployment of operational applications that can illustrate results.
Douetteau says “the biggest challenge of most data science projects is getting everyone on the same page in terms of business goals, technical requirements, project challenges, and responsibilities. More often than not, there is a disconnect between the worlds of development and production. Some teams may choose to re-code everything in an entirely different language while others may make changes to core elements, such as testing procedures, backup plans, and programming languages.”