This IBM® Redbooks® publication describes visual development, visualization, adapters, analytics, and accelerators for IBM InfoSphere® Streams (V3), a key component of the IBM Big Data platform. Streams was designed to analyze data in motion, and can perform analysis on incredibly high volumes with high velocity, using a wide variety of analytic functions and data types. The Visual Development environment extends Streams Studio with drag-and-drop development, provides round tripping with existing text editors, and is ideal for rapid prototyping. Adapters facilitate getting data in and out of Streams, and V3 supports WebSphere MQ, Apache Hadoop Distributed File System, and IBM InfoSphere DataStage. Significant analytics include the native Streams Processing Language, SPSS Modeler analytics, Complex Event Processing, TimeSeries Toolkit for machine learning and predictive analytics, Geospatial Toolkit for location-based applications, and Annotation Query Language for natural language processing applications. Accelerators for Social Media Analysis and Telecommunications Event Data Analysis sample programs can be modified to build production level applications. Want to learn how to analyze high volumes of streaming data or implement systems requiring high performance across nodes in a cluster? Then this book is for you. Please note that the additional material referenced in the text is not available from IBM.

This IBM® Redbooks® publication describes the architecture and components of IBM InfoSphere® Optim™ Performance Manager Extended Edition. Intended for DBAs and those involved in systems performance, it provides information for installation, configuration, and deployment. InfoSphere Optim Performance Manager delivers a new paradigm used to monitor and manage database and database application performance issues. It describes product dashboards and reports and provides scenarios for how they can be used to identify, diagnose, prevent, and resolve database performance problems. IBM InfoSphere Optim Query Workload Tuner facilitates query and query workload analysis and provides expert recommendations for improving query and query workload performance. Use InfoSphere Optim Performance Manager to identify slow running queries, top CPU consumers, or query workloads needing performance improvements and seamlessly transfer them to InfoSphere Optim Query Workload Tuner for analysis and recommendations. This is done using query formatting annotated with relevant statistics, access plan graphical or hierarchical views, and access plan analysis. It further provides recommendations for improving query structure, statistics collection, and indexes including generated command syntax and rationale for the recommendations. Please note that the additional material referenced in the text is not available from IBM.

This IBM® Redbooks® publication is intended for business leaders and IT architects who are responsible for building and extending their data warehouse and Business Intelligence infrastructure. It provides an overview of powerful new capabilities of Information Server in the areas of big data, statistical models, data governance and data quality. The book also provides key technical details that IT professionals can use in solution planning, design, and implementation.

Typical deployment architectures introduce challenges to fully using the shared metadata platform across products, environments, and servers. Data privacy and information security requirements add even more levels of complexity. IBM® InfoSphere® Information Server provides a comprehensive, metadata-driven platform for delivering trusted information across heterogeneous systems. This IBM Redbooks® publication presents guidelines and criteria for the successful deployment of InfoSphere Information Server components in typical logical infrastructure topologies that use shared metadata capabilities of the platform, and support development lifecycle, data privacy, information security, high availability, and performance requirements. This book can help you evaluate information requirements to determine an appropriate deployment architecture, based on guidelines that are presented here, and that can fulfill specific use cases. It can also help you effectively use the functionality of your Information Server product modules and components to successfully achieve your business goals. This book is for IT architects, information management and integration specialists, and system administrators who are responsible for delivering the full suite of information integration capabilities of InfoSphere Information Server.

To make better informed business decisions, better serve clients, and increase operational efficiencies, you must be aware of changes to key data as they occur. In addition, you must enable the immediate delivery of this information to the people and processes that need to act upon it. This ability to sense and respond to data changes is fundamental to dynamic warehousing, master data management, and many other key initiatives. A major challenge in providing this type of environment is determining how to tie all the independent systems together and process the immense data flow requirements. IBM® InfoSphere® Change Data Capture (InfoSphere CDC) can respond to that challenge, providing programming-free data integration, and eliminating redundant data transfer, to minimize the impact on production systems. In this IBM Redbooks® publication, we show you examples of how InfoSphere CDC can be used to implement integrated systems, to keep those systems updated immediately as changes occur, and to use your existing infrastructure and scale up as your workload grows. InfoSphere CDC can also enhance your investment in other software, such as IBM DataStage® and IBM QualityStage®, IBM InfoSphere Warehouse, and IBM InfoSphere Master Data Management Server, enabling real-time and event-driven processes. Enable the integration of your critical data and make it immediately available as your business needs it.

In this IBM® Redbooks® publication, we discuss and describe the positioning, functions, capabilities, and advanced programming techniques for IBM InfoSphere™ Streams (V2), a new paradigm and key component of IBM Big Data platform. Data has traditionally been stored in files or databases, and then analyzed by queries and applications. With stream computing, analysis is performed moment by moment as the data is in motion. In fact, the data might never be stored (perhaps only the analytic results). The ability to analyze data in motion is called real-time analytic processing (RTAP). IBM InfoSphere Streams takes a fundamentally different approach to Big Data analytics and differentiates itself with its distributed runtime platform, programming model, and tools for developing and debugging analytic applications that have a high volume and variety of data types. Using in-memory techniques and analyzing record by record enables high velocity. Volume, variety and velocity are the key attributes of Big Data. The data streams that are consumable by IBM InfoSphere Streams can originate from sensors, cameras, news feeds, stock tickers, and a variety of other sources, including traditional databases. It provides an execution platform and services for applications that ingest, filter, analyze, and correlate potentially massive volumes of continuous data streams. This book is intended for professionals that require an understanding of how to process high volumes of streaming data or need information about how to implement systems to satisfy those requirements. See: http://www.redbooks.ibm.com/abstracts/sg247865.html for the IBM InfoSphere Streams (V1) release.

In this IBM Redbooks publication, we provide an overview of Informix Dynamic Server (IDS) 11. IDS is designed to help businesses leverage their existing information assets as they move into an on demand business environment. Requirements here call for a flexible data server that can accommodate growth, in applications, data volume, and numbers of users. And it offers the capability to minimize downtime and to provide the high availability required today. A new suite of business availability functionality provides greater flexibility and performance, automated statistical and performance metric gathering, improvements in administration, and reductions in operating costs. The IDS technology enables efficient use of existing hardware and software, including single and multiprocessor architectures. And it helps you keep up with technological growth, including such things as the use of nontraditional data types. Built on the IBM Informix Dynamic Scalable Architecture™ (DSA), IDS provides a next-generation parallel data server architecture that delivers mainframe-caliber scalability; manageability and performance; minimal operating system overhead; and automatic workload distribution. IDS delivers a lower total cost of ownership (TCO) by leveraging its well-regarded general ease of use and systems administration. It enables customers to use information in new and more efficient ways to create business advantage.

This book provides an overview of the high availability and enterprise replication features of Informix Dynamic Server (IDS) Version 10, which can simplify and automate enterprise database deployment. Version 10 offers patent-pending technology that virtually eliminates downtime and automates many of the tasks associated with deploying mission-critical enterprise systems. The high availability capability can reduce or eliminate costly downtime through, as examples, the introduction of online index rebuild, the capability to create and drop indexes online without locking tables, and point-in-time table-level restore. Enhanced enterprise replication provides solutions for those customers requiring reliable and quick dissemination of data across a global organization. The replicated data can also participate in the high availability environment with capabilities such as seamless online resynchronization of enterprise replication nodes at startup, for example. There is also enhanced capability for high-availability disaster recovery customers in the form of the ability to resend primary server indexes to HDR secondary servers without requiring a rebuild of the index on the primary server. These significant and powerful capabilities can enable you to intelligently replicate (distribute) your enterprise data to improve the availability of that data to better service the requirements of your enterprise.

This IBM Redbooks publication provides an overview of the Informix Dynamic Server (IDS), Version 10. IDS provides the reliability, flexibility, and ease of maintenance that can enable you to adapt to new customer requirements. It is well known for its blazing online transaction processing (OLTP) performance, legendary reliability, and nearly hands-free administration for businesses of all sizes--all while simplifying and automating enterprise database deployment. Version 10 offers significant improvements in performance, availability, security, and manageability, including patent-pending technology that virtually eliminates downtime and automates many of the tasks that are associated with deploying mission-critical enterprise systems. New features speed application development, enable more robust enterprise data replication, and enable improved programmer productivity through support of IBM Rational development tools, JDBC 3.0, and Microsoft .NET as examples. Version 10 provides a robust foundation for e-business infrastructures with optimized Java support, IBM WebSphere certification, and XML and Web services support. Ready for service-oriented architecture (SOA)? This book also includes descriptions and demonstrations of support that are specific to IDS for an SOA.

In this IBM Redbooks publication we describe and discuss DB2 Data Warehouse Edition (DWE) Version 9.1, a comprehensive platform offering with functionality to build a business intelligence infrastructure for analytics and Web-based applications, and best practices for deployment. DB2 DWE integrates core components for data warehouse construction and administration, data mining, OLAP, and InLine Analytics and reporting. It extends the DB2 data warehouse with design-side tooling and runtime infrastructure for OLAP, data mining, InLine Analytics, and intra-warehouse data movement and transformation, on a common platform based on DB2 and WebSphere. The platform pillars are based on the technology of DB2, Rational Data Architect (for physical data modeling only), the SQL Warehousing Tool, Intelligent Miner, DB2 Cube Views, and Alphablox. DWE includes an Eclipse-based design environment, DWE Design Studio, that integrates the DWE products (with the exception of Alphablox and Query Patroller) with a common framework and user interface. The new SQL Warehousing Tool enables visual design of intra-warehouse, table-to-table data flows and control flows using generated SQL. DB2 Alphablox is the tool for developing custom applications with embedded analytics-based visual components. DWE enables faster time-to-value for enterprise analytics, while limiting the number of vendors, tools, skill sets and licenses required.

In this IBM Redbooks publication, we describe and demonstrate how to implement enterprise performance insight. This is an initiative that has a primary focus on the integration of Business Process Management and Business Intelligence. With this capability, management has an enterprise-wide view of their business that can enable proactive business management. We discuss the techniques, architectures, and processes used to define and implement such an environment. Among the specific techniques and technologies used are key performance indicators, process alerts, management dashboards, analytic applications, application integration, process modeling and monitoring, and real-time business intelligence. The products featured are DB2 UDB, DB2 Alphablox, WebSphere Information Integrator, WebSphere Portal, WebSphere Business Monitor, and WebSphere Business Modeler. Performance insight is an element of a more global initiative called business innovation and optimization (BIO). With this, we can enable business performance management, an initiative for the effective use of people, processes, assets, and technology to proactively achieve business goals and measurements. It enables strategic alignment of business and technology, resulting in real-time access to data and continuous process and data flow, for proactive business management, and business goal attainment.

The acquisition of Informix by IBM has provided the opportunity for Informix customers to consider new alternatives to further enrich their data management systems infrastructure. They can now more easily take advantage of available products, services, and capabilities as they grow and change. This IBM Redbooks publication focuses on strategies, techniques, capabilities, and considerations for using Informix Extended Parallel Server (XPS) and DB2 Universal Database (UDB). It provides detailed discussions and data to give a good understanding of the two products, their capabilities, and their similarities. XPS customers can choose to adopt a database strategy of coexistence or consider transitioning to DB2 UDB. The features and functionality of each DBMS are briefly described for a better understanding, in areas such as architecture, partitioning techniques, SQL considerations, configuration, indexing, data types, DML, and DDL. It also discusses products and tools to complement these database management systems. With this information, you can better decide which products satisfy your particular requirements, and better plan on how to achieve your objectives as you develop your database management system strategy. You will be better positioned to make informed decisions that can give you the best return on your DBMS investment.

SAP is a leading ERP vendor, with a large install base. A key element in their product set is the SAP Business Information Warehouse (BW). The primary objective of this IBM Redbooks publication is to provide guidelines to help you implement your SAP Business Information Warehouse on DB2 UDB ESE. Two major considerations when building a business information warehouse are scalability and performance. In this book, we have demonstrated the wide range of scalability of BW when implemented on DB2, while maintaining the performance requirements that are so critical. The parallelism and data partitioning capabilities of DB2 Universal Database ESE, enables a robust, highly scalable, and high performance business information warehouse. For a common understanding, we first discuss the concepts of data warehousing and then describe the SAP architecture and robust component capabilities of the SAP business information warehouse. To help in your implementation, we provide guidelines for how to configure SAP BW when it is built on DB2. We also describe and discuss the key capabilities and parameters to help you get the best from DB2. Key topics such as sizing, partitioning, performance tuning, and systems administration, are discussed to assist in the implementation and maintenance of your system. This book will help enable you to more quickly and easily implement a robust SAP BW on DB2 UDB ESE.

In this IBM Redbooks publication we discuss primary processes and various alternatives that prepare you in implementing a DB2 near-realtime business intelligence environment. We discuss architectural alternatives and include overviews of software products that you can use in an implementation. As a primary focus, we tested the capabilities for supporting continuous update of a DB2 data warehouse while running a continuous concurrent query workload against that data warehouse. We tested several implementation scenarios and the variables that impact them. The results of our testing and the issues we encountered are provided.

This IBM Redbooks publication describes how to create and implement a federated data management environment. That environment can enable access to, and use of, multiple heterogeneous data sources as if they were all resident in the same data management system. We use Informix Dynamic Server (IDS) and DB2 as the primary data sources, along with Informix Extended Parallel Server (XPS), Red Brick Warehouse, Oracle9i, and Microsoft Excel as data sources. We also use data management tools, such as IBM DB2 Information Integrator and Informix Enterprise Gateway Manager, to provide the data federation. For data access tools, we use DB2 Command Center, Server Studio JE for Informix, and Brio Explorer to show data federation in action. With the combined functionality of the Informix and DB2 database management systems and the DB2 Information Integrator, you can implement a very powerful federated data management environment. Informix customers will be well positioned to take advantage of the expanded capabilities for integration through data federation, as well as future enhancements.