Skip to main content

Internal Data Services

Internal Data Services form the backbone of our system's data infrastructure, providing access to various data sources within the organization. They are categorized into three main sub-services - Services for the Internal Data Warehouse, Services for Live Crawling Endpoints, and Services for Query by Forums.

Data Services for the Internal Data Warehouse​

Our system hosts a robust internal data warehouse with structured tables for efficient data management. Each table in our warehouse corresponds to a unique data service that comprises of two parts:

  • Query Service: This service allows users to query data from the corresponding table in real-time. It's optimized to provide quick responses to queries, allowing for efficient data access.
  • Background Sync Service: This service works in the background to ensure the data in the warehouse is always updated. It syncs the internal warehouse data with live sources periodically, thereby ensuring data accuracy and freshness.

Examples of these services include data delhi hc, data ecourts hc, data itat, data ncdrc, data nclat, and data nclt.

Data Services for Live Crawling Endpoints​

Live Crawling Endpoints are a critical part of our system, enabling real-time data retrieval from various sources. These services are split into four main categories:

  • Service Crawlers Regulatory: This service populates regulatory data from multiple sources such as SEBI, CCI, EPF defaulters, and others.
  • Service Crawlers Litigation: It populates litigation data from various courts and tribunals, providing critical insights into ongoing and past litigation.
  • Service Crawlers Enhancement: This service enhances litigation records by supplementing additional information and context to the base data.
  • Service Crawlers Media: It focuses on media data, fetching data from analyst-specified URLs and Google news. This provides a comprehensive view of the media landscape for a given topic.
  • Service Crawlers Company Overview: It populates company and director information from various sources, giving a complete overview of a company and its key personnel.

Data Services for Query by Forums​

These services provide a flexible and efficient way to query data based on specific forums such as supreme courts, high courts, district courts, tribunals, and regulatory bodies. These services internally call upon the appropriate data service or live crawler service based on the forum and return a merged set of records, thereby reducing false positives. This service also employs sophisticated matching algorithms to classify records based on their relevance (Perfect Match, High Probable Match, Low Probable Match, or No Match).

In summary, our Internal Data Services offer robust and comprehensive access to the vast internal data resources within our system, while ensuring data accuracy and freshness. These services play a crucial role in facilitating efficient data management and access across our platform.