Day in Day out while testing we do a comparison of these files which could be very complex and contain a large number of key-value pairs (out of order). It is a repetitive task and is very time consuming.

Reconciliation of Data present in XML's / JSON / CSV.

Previously the comparison was being done manually. Here we have built a reusable UIPath Activity.

1. Cost Saving and time saving (XML with 10M records processing in under 3 minutes)
2. Reporting
3. Reusability and open to use for all

1. In a bank, a trade booking system is being migrated on to a new version and you need to compare/test the publication of trades. You need to be sure that all the attributes being sent are present and correctly mapped.

2. E-Commerce exchanges their data using XML with different applications and services. Hence the schema of the data changes. This tool can be used to validate the data before the data gets consumed.

User needs to drop an email with the location of the file which needs to be compared. BOT would be polling the inbox and would trigger the process which will read the file and do a comparion. In case there are mismatches it will reply back on the same email with an html report highlighting the gaps. If there are no discrepancies encountered a success mail would be sent out.

1. The tool monitors the number of unread emails with subject containing the word compare
2. Picks the files contained in the email compares the source and target files
3. Source and Target files are specified by the user sending the email
4. Creates a result file after reconciliation
5. User gets back and email with the comparison result

1. The tool handles malformed files
2. The tool can handle cases where the order of keys is not the same across the two files
3. It can handle cases where the key names are not same across files. This is achieved using a mapping file supplied by the user
4. If source or target is not present the comparison fails
5. In case some different files format is provided, a failure mail is sent

1. The report renders as an HTML, hence making it available anywhere
2. The report provides advance search and filters to narrow down results

1. .Net 4.6.1
2. UIPath Studio 2019.7.0
3. UIPath Robot

1. Configure the user email in the Activity
2. Publish the activity
3. Go to UIPath platform and run the job using the name ReconActivity

Measureing the quality of data is one imporant step, data quality is measured on the following parameters

1. Accuracy : Ratio of the data to errors, (there is no industry standard, depends on the size and nature of the data)
2. Consistency checks: Making sure that the data is consistent across the two files, i.e. sum of prices of products in the two files is same
3. Completeness: The data is complete
4. Timeliness: The event of file process comparison can be automatically triggered, the system will monitor such events and triggered if the events deviate from the regular cadence

1. Common error patterns will be recognised and the system owners will be notified of the same to rectify any problems in the upstream data processing. Common patterns might include: a) The cadence of the comparison event b) The pattern of the
2. Descriptive analytics on the error logs provide a overall picture

1. Integration with GCP,Azure for storing and reading the data on storage services (WIP)
2. Integration with other popular file formats like protobuf, yml etc
3. Maintaining record of all the comparisons in a NoSQL db
4. Self containing runs