Kickstart your Big Data journey

Momentous is our enterprise ecosystem of global data with batch and real time tools & capabilities that enables use cases across all lines of business through advanced analytics, machine learning, real time compute and APIs, streaming data and self-service tools and utilities. The ecosystem is expected to house over 1PB of data at any given time, housing a comprehensive data from authoritative sources (SOR’s) across the enterprise with democratized integration and development of derived data sets by analytics and power users. The Platform supports both batch and streaming data ingestion. Data is catalogued in a centralized MDM application and allows users to discover and access data for basic to advanced analytics and modeling.

AZDA is an interactive self-service tool that enables business users to leverage Momentous data and manage policies/processes. Users will leverage the tool to design and develop map-reduce functions at the same time. The tool will support basic data quality checks as well as core statistical functions such as mean, median and mode. Core features include:

• 1. Intuitive UI that allows users to design and code their data transformations
• 2. Ability to discover data by integrating with the centralized MDM application
• 3. Ability to join, merge and transform data through graphical drag and drop
• 4. Ability to generate executable code (Hive, Pig & Python)
• 5. Ability to schedule production map-reduce jobs
• 6. Role and Rule based authentication and authorization
• 7. Ability to track lineage of data from SOR’s to derived

AZDQ is an interactive data quality management framework that allows users to specify the data quality rules, attributes, entitlements and error thresholds as data is ingested into the Apollo ecosystem. This tool will integrate with the centralized MDM application through API’s and will allows users to specify data quality rules for new and existing data feeds.
Core features include:

• 1. Rule Definition through interactive drag and drop UI
• 2. Basic and advanced data quality functions should be built into the tool. For e.g., date checks, bounds, delimiters, error thresholds etc.
• 3. Rule Governance – Ability for supervisors to review and approve DQ rules
• 4. Ability to define both preventive (pre-ingestion) and detective (post-ingestion) rules for data feeds
• 5. Ability to raise corrective action based on the outcomes of DQ checks including Accept/Reject/Suspend feed and Alert registered users
• 6. Attribute Profiling
• 7. Versioning and Entitlement
• 8. Volume based trending and predictive analytics
• 9. Attribute Stats collection
• 10. Logging & Monitoring including:
  a. Threshold breach and Job abends
  b. Issue Management and Resolution
• 11. Subscription based alerts

This application is called AZDEV, we develop this platform mainly using Microsoft technologies like .Net, SQL, Azure Cloud, Javascript. MVC. It also requires other technologies like java, spring, hibernate, Aws etc. Targeted audience are all small and mid level businesses who have application maintenance and storage. Our application will help them in reducing the costs and time.