Regulator Sources - CIBIL Records
The regulator_sources schema in our Data Warehouse contains the cibil_records table. This table is a significant source of data, providing crucial insights into credit behaviour, and is instrumental for economic and financial analysis.
CIBIL, or Credit Information Bureau (India) Limited, is India's premier Credit Information Company (CIC). CIBIL collects and maintains records of individuals' and companies' loan and credit card payments. These records are submitted to CIBIL by banks and other lenders, on a monthly basis.
CIBIL Defaulter Suit Filed (NPA) Records
In our cibil_records table, one category of records stored is the CIBIL Defaulter Suit Filed (NPA) records. This data represents instances where a defaulter's non-performing asset (NPA) status led to the lender filing a lawsuit. These records specifically target economic defaults of more than 1 crore INR.
The fields of the cibil_records table storing this data provide information about the borrower, the amount in question, geographical details, among other things.
CIBIL Wilful Defaulter Suit Filed Records
Another category of records in our cibil_records table represents the CIBIL Wilful Defaulter Suit Filed instances. These are cases where the borrower had the capacity to repay the borrowed amount but intentionally defaulted on their payments. The focus is again on economic defaults of more than 25 lakh INR.
The data points collected and stored for this category provide a detailed overview of the defaulters' credit behaviour, offering valuable insights for risk assessment and mitigation.
ETL Pipelines and CIBIL Records
The ETL pipelines play a pivotal role in processing and managing the CIBIL records data.
Extraction
The first step involves data extraction, where data scrapers fetch the latest records from CIBIL and other regulatory databases.
Transformation
In the transformation phase, the raw data is cleaned, normalized, and structured. This process ensures that the extracted records are ready for analysis and can be easily understood.
For CIBIL Defaulter Suit Filed (NPA) and Wilful Defaulter Suit Filed records, this involves checking the validity of each data point, correcting errors (if any), and standardizing the data format for easy comparison and aggregation.
Loading
Once the transformation process is completed, the cleaned and structured data is loaded into the cibil_records table in the Data Warehouse. This step ensures the latest credit behaviour data is available for analysis and reporting.
Conclusion
The CIBIL records in the regulator_sources schema provide a vital data source for the Data Warehouse. They offer significant insights into credit behaviour and financial reliability, contributing to comprehensive due diligence processes. The ETL pipelines ensure these data records are extracted, cleaned, and loaded efficiently, maintaining the data's quality and accuracy.