Daily pipeline for corporate financial filings

Challenge

PwC wanted a program that synchronised an in-house database with all the latest financial filings committed by Danish companies on virk.dk — and made the filings available in a queryable format.

Solution

A fully automated acquisition, processing and persistence pipeline, deployed to run nightly.

• Data acquisition. A scripted job scans virk.dk for recent filings, compares against processed data and downloads anything new.
• Data processing. XBRL markup converted to structured relational form, with internal tags and references preserved so no content is lost.
• Data persistence. Tables, schemas and views in an SQL database hold the data permanently — including ready-made financial-ratio views.

Results

• Fully developed & deployed pipeline
• Runs automatically every night
• Database powers statistical analysis & automated reporting
• Ratio views speed up common analyses