Overview
PEI Group, a key player in financial media, approached Elastic Mint with a need to streamline data imports from a range of spreadsheets into their core systems. The challenge lay in both validating the spreadsheet data and integrating it into their GraphDB and OpenSearch environments. PEI Group required a robust solution that would handle diverse data sources while ensuring accuracy and ease of use for their internal teams.
The Challenge
PEI Group’s data was stored in a spreadsheet, making it crucial to validate and structure this information efficiently before importing. The complexity increased as the data needed to be integrated into GraphDB—a graph database that differs significantly from the relational databases many developers are accustomed to. GraphDB offers advantages in understanding data relationships but can make visualisation tricky for developers used to more conventional data structures.
Our Solution
Elastic Mint provided a small team of two developers who collaborated closely with PEI’s internal teams to develop a tailored import solution. The tool, built with TypeScript and NodeJS, was designed to:
- Validate Data: Ensure data integrity by validating entries in the spreadsheets before import.
- Seamless Integration: Import validated data first into GraphDB and then into OpenSearch, making the information accessible and searchable.
Results
The data import solution significantly reduced manual processes for PEI Group, improving data quality and consistency across their systems. Overall, the collaboration allowed PEI to focus on their core tasks while Elastic Mint managed the technical complexities.
Technologies Used
- TypeScript & NodeJS: For the development of the import functionality.
- GraphDB: As the graph database solution.
- OpenSearch: For indexing and enhanced data accessibility.
Working with PEI Group
Elastic Mint worked side-by-side with PEI Group’s internal teams, ensuring the solution was well-integrated and tailored to their specific needs. Our hands-on approach ensured that PEI’s objectives were met effectively, with a focus on delivering a solution that not only worked but was also well understood by those using it.
