United Kingdom +44 (0) 1424 863 450   hello@simego.com

Feature Matrix - Develop and Automate

DS3 is a feature complete Integration solution encompassing the complete life-cycle of a successful integration project


Simego integration solutions are designed to be straightforward to purchase, deploy, extend, administer and support. Our solutions give IT managers central control over their information infrastructure, including standards, security and auditing, while still offering business units the flexibility to react quickly to changing integration requirements. To simplify system administration, the Simego product suite is built on top of Microsoft technologies, deploys quickly and easily scales to accommodate both an increasing number of integrations and high-volume data growth. 

Developer Features

Connectivity

Sources and Targets
Connect to many information worker solutions and the databases that support them such as Sharepoint, Dynamics CRM, Excel files and ODBC Database
Data Source Discovery
Rather than using complex 'connection string' and 'entity' definitions, DS3 Designer discovers the target systems schema and allows you to select the tables in a database, the lists or document libraries in a Sharepoint site and the entities in a Dynamics CRM system
Automatic Schema Discovery
DS3 Designer discovers the columns and data types of your source and target systems including more complex types like 64 bit encoded files, string arrays and GUIDs as well as strings, numbers and dates
Up to Date Connectors
Simego consistently develop, test and release their connectors to utilise the latest features made available from their systems
Dynamics CRM Connectivity
DS3 Designer and Automation Server supports multi threaded batch based API integration with Dynamics CRM. Throughput of 500 to 1000 rows per second including rows containing lookups make it the only choice for Enterprises with significant Dynamics CRM deployments looking for Near-Real-time synchronisation. Our specific N:N Dynamics CRM relationship connector simplifies the creation and management of relationships.
SharePoint Connectivity
DS3 Designer and Automation Server supports SharePoint 2007-2013 via WebServices API and Client Object Model API. DS3 supports Standard Lists for Data and Document Libraries for Files including Tagging Meta Data to Document Libraries. There is no requirement to install or run anything directly on your SharePoint Environment as DS3 accesses everything remotely.
ODBC, OleDb, Oracle, MySQL, MS SQL Server Connectors
DS3 Designer and Automation Server connects to virtually any kind of Database Server either via a Dedicated Provider or ODBC Driver. DS3 Supports direct Table Access and View along with custom SQL Support and Server Side filtering via WHERE Clause filter.
Excel, CSV and XML Connectors
DS3 Designer and Automation Server supports Excel xsl and xlsx files via Microsoft Office Drivers, a Custom Fast CSV file Reader and XML File Support. CSV and XML Files support wild card mapping to combine multiple files into 1 datasource.
OData Connector
Use DS3 Designer and Automation Server with custom systems via the use of the OData Protocol.

Mapping Designer

Drag and Drop
DS3 has been designed the minimise the requirement for users to need development skills. It is simple to connect systems together by dragging the source fields on to the targets in a familiar windows application.
Excel like Functions
Using familiar Excel like functions such as CONCATENATE, IF, ELSE and more advanced text functions like CASE and FORMAT users can quickly develop complex transformations often required when mapping between systems. For example 'high','low' and 'medium' values can simply be mapped to '1','3' and '2'
Advanced .NET Code Option
Write advanced data transformations with the full .NET 4.0 Framework, using Dynamic Columns with the Code Designer allows for development of really complex transformation when simple scripting is not enough. The code is compiled at run time to ensure maximum execution performance.
High Speed Lookups
Often during integrations it is required to find the 'Account' associated with a 'Client'. DS3 contains simple Excel like functions to lookup reference data from any of its connectors. These lookups are cached locally and do not reduce the speed of the integration.
Source and Target Data Preview
The ability to view the source and target data whilst developing an integrations allows for an agile approach to integration development
Synchronised Data Preview
Integration development is often time-consuming due to them often changing large amounts of data. Being able to preview the data changes that will be made saves costly mistakes and reduces the time required to develop new integrations.

Scalability

Large Data Sets
DS3 can comfortably load and reconcile data sets containing many millions of rows.
Unique Reconciliation Engine
DS3's comparison engine can reconcile and detect difference between large datasets in the fraction of the time of competing solutions.
Low Memory Usage
By combining disk and active memory management DS3 can load data sets far larger that the available memory in the physical computer being used for the synchronisation.
Sharding for massive Datasets
By identifying chunks or shards of data using keys such as zip codes, client numbers, or prefixes DS3 can be used in parallel to keep large data synchronised. This can only be achieved using the Automation server to coordinate the synchronisation.

Reliability

Idempotent - Repeat with no fear of duplicates or data corruption
DS3's approach of first reconciling systems first before making changes is unique in the synchronisation product space. This approach allows synchronisation processes to be stopped half way through, restarted after failure, run consistently without fear of corrupting the source or target systems with duplicates or invalid data.

Automation Features

Automation Projects and Tasks

Project based Integration - Automate the Steps required for an Integration
Integrating systems often requires many steps just to achieve a single channel. Steps such as moving a files into the correct place, backing up a database or running several synchronisation tasks can be contained in a project for easy management and execution.
Version Control with Roll-Back
As you change the configuration of a step the Automation server retains a historical records allowing teams to understand the changes a integration has gone through. This is especially important when diagnosing operational issues as their root cause is often uncontrolled change. In addition to recording the changes you can rollback to a previous version.
Data Synchronisation Steps
Data synchronisation tasks created by the designer are stored inside the server. The serve executes the tasks on dedicated windows services or DS3 Automation Agents.
SSIS Steps
SSIS is the most popular Data Integration Tool available and DS3 server enhances its power with Monitoring, Scheduling, Versioning, Change Control, Log Storage, selective location execution and configuration documentation
Command Line Execution Steps
Executing windows executables allows the use of Legacy or custom developed applications to be scheduled and managed from inside a single engine. 
File System, Email, SMS, Services FTP, and Web API Action Steps
The automation server has a considerable list of utility steps for automating the enterprise. 
Failure Steps
In the case of a step failing to execute correctly, steps can be configured to execute selectivity. Examples may be sending an email to an operator or moving a file to a failure queue.
Parallel Integration Steps
Wherever execution time is a premium (such as a migration) you can execute projects in parallel to reduce the overall execution of sets of projects. The Automation server also includes Steps that wait for parallel projects to complete.

Monitoring and Notifications

Dedicated Real-Time Dashboard
Transparency and feedback to the underlying processes are key to successful integration. DS3 Automation Server's graphical dashboard details, currently processing projects, failed projects and historical performance comparison at a step level.
Notifications
Easily configure email and SMS notifications on failure including attaching detailed logs if required.

Auditing and Debugging

Auditing
A dedicated audit trail records when, who and what was changed in the integration projects and is available from the Web Management Console.
Debugging
Every execution of every step is included in a specific log which is accessible in real-time from the management console. It drill down through all of the processes and exceptions. In exceptions circumstances additional logging levels can be activated from the Management Console.