In today's world information is required to flow from heterogeneous systems across organization boundaries.
An inherent problem with this flow is that the outputs from one system rarely fit the required inputs required by the receiving system, this requires some form of ETL processing (Extract Transform Load).
The volume of information is on a scale which no human can process in a timeous manner, and therefore computing is required.
This type of ETL is currently happening across organizations on a dally basis.
Hiring a developer is costly as one needs to specify the exact requirements in order that the developer
can write the code to read the source files and develop a way of transform the data into the required format.
This leads to the development of something which was probably
the best they could do with the time and knowledge they have.
Sources and destination are unique which means that this is performed for each file where the format is different. Each time there is a new source format or format changes a new transformation process is required, a developer is therefore required every time as the code will need to be modified.
Creating Software As A Service(SaaS).
Understanding
Part of the challenge is explaining what the "fuss" is all about and why its important.
"The Challenge" section is here to help, as without an understanding,
the perceived value cannot be evaluated.
Without these details the service/system cannot be evaluated in its entirety.
Demo vs the real thing.
An example, it is important to highlight, this demo site is running from the lowest tire web server.
(To keep personal cost down, as no income is generated at all)
The server hosting resource are limited, this affects the available memory,
processing power, IO access speed, and ultimately affects the performance and experience.
Availability is based on the hosting company, the actual system will be on a dedicated servers,up time would be guaranteed by the hosting systems.
Run autonomously, meaning receiving input automatically.
As the input into the system is files, configuration options to specify the location of where file can be supplied.
This is done using ftp/ftps, these are existing file transfer protocols, config enables you to setup and configure pickup options.
Plan your workflow, setup ftp communication and then schedule.
Files are fetched queued and proceed automatically according to their configuration options.
Data is usually critical to daily operations and therefore there is extreme pressure to get the data into the destination systems.
The amount of time it takes to process this information becomes very, if not critical to the success of the organization operations.
If manual intervention is required, you want to be notified of this as soon as possible, notification will be alerted to the relevent persons, with the automation and tooling this allows you to quickly identify the reasons for interventions.
| Date | Price | Quantity | Product Code | Figure |
|---|---|---|---|---|
| 2/3/17 | R 56 | 22.00 | RJ-3526 | A3 (2) |
| 2/3/17 | R 56 | 2.00 | RJ-3526 | A3 (5) |
| 2/3/17 | R 56 | 6.00 | RJ-3526 | A3 (22) |
| Date | Price | Quantity | Product Code | Figure |
|---|---|---|---|---|
| 2017/02/03 | £3.27 | 22 | 3526 | 2 |
| 2017/02/03 | £3.27 | 2 | 3526 | 5 |
| 2017/02/03 | £3.27 | 6 | 3526 | 22 |
| Field/Column | Description |
|---|---|
| Date | The format has changed from d/M/YY to YYYY/MM/dd |
| Price | A currency conversion has taken place from Rand to Pounds |
| Quantity | The number format for the quantity has changed. |
| Product Code | In the destination system the RJ- prefix is not used so must be removed. |
| Figure | In the destination system only the value in brackets is used the rest must be removed. |
Performance is the main driver behind Paradox Importer.
Performance is the main driver for this service. Typical speed improvements are in the region of 1000% i.e.Hours to Minutes to seconds.
Quickly change and check that what you have setup is meets your requirements.
Paradox Importer removes the need to write any code, instead you build up what you want.
Changes can be made without requiring a developer.
With Paradox Importer you can quickly change and check that what you have setup is correct.
Create complex transformation logic, which would otherwise involve coding nightmare in terms of understanding and maintaining, with the likelihood of create a performance bottle necks.
Custom or unique function logic can quickly be added.
Excel both (.xls and .xlsx) and csv's
Currently this service is in construction.
If you would like to be come and earily adoptor
or interested in the service contact the owner;
contact email: Calvin_Nel@msn.com